-- Logs begin at Mon 2022-05-09 03:34:00 UTC, end at Mon 2022-05-09 04:41:49 UTC. -- May 09 04:17:25.805629 dv-cinder-838009-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 09 04:17:25.814885 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 09 04:17:25.816185 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 04:17:25 2022] *** May 09 04:17:25.816185 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 04:17:25.816185 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 04:17:25.816185 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: nodename: dv-cinder-838009-3-iscsi May 09 04:17:25.816185 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: machine: x86_64 May 09 04:17:25.816185 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: clock source: unix May 09 04:17:25.816185 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: pcre jit disabled May 09 04:17:25.816185 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: detected number of CPU cores: 4 May 09 04:17:25.816185 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: current working directory: / May 09 04:17:25.816185 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: detected binary path: /usr/bin/uwsgi-core May 09 04:17:25.816868 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: your processes number limit is 47680 May 09 04:17:25.816868 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: your memory page size is 4096 bytes May 09 04:17:25.816868 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: detected max file descriptor number: 2048 May 09 04:17:25.816868 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: lock engine: pthread robust mutexes May 09 04:17:25.816868 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: thunder lock: enabled May 09 04:17:25.816868 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 09 04:17:25.816868 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 04:17:25.862483 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: Python main interpreter initialized at 0x5570627909c0 May 09 04:17:25.862483 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: python threads support enabled May 09 04:17:25.862483 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: your server socket listen backlog is limited to 100 connections May 09 04:17:25.862483 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: your mercy for graceful operations on workers is 90 seconds May 09 04:17:25.862805 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: mapped 403077 bytes (393 KB) for 2 cores May 09 04:17:25.862879 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: *** Operational MODE: preforking *** May 09 04:17:25.863143 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: *** uWSGI is running in multiple interpreter mode *** May 09 04:17:25.863143 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: spawned uWSGI master process (pid: 102482) May 09 04:17:25.863329 dv-cinder-838009-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 09 04:17:25.864458 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: spawned uWSGI worker 1 (pid: 102483, cores: 1) May 09 04:17:25.864458 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: spawned uWSGI worker 2 (pid: 102484, cores: 1) May 09 04:17:25.864458 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 04:17:27.063079 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 04:17:27.079109 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 04:17:27.795915 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 04:17:27.795915 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: from cryptography.utils import int_from_bytes May 09 04:17:27.796244 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 04:17:27.796244 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: from cryptography.utils import int_from_bytes May 09 04:17:27.802965 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 04:17:27.802965 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: from cryptography.utils import int_from_bytes May 09 04:17:27.803295 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 04:17:27.803295 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: from cryptography.utils import int_from_bytes May 09 04:17:30.410119 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 04:17:30.410689 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 04:17:30.410881 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 04:17:30.411238 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 04:17:30.411491 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 04:17:30.411875 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.412226 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.412551 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.412868 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.413195 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.413506 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.413827 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.414149 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.414504 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.414823 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.415141 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.415465 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-838009-3-iscsi {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.415787 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.416114 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.416424 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.416740 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.417045 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.417368 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.417671 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.418166 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.418608 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.418913 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.419222 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.419576 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.419870 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.420120 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 04:17:30.420743 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.420930 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 04:17:30.421090 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.421090 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.421484 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 04:17:30.421675 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.421867 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 04:17:30.422058 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.422252 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 04:17:30.422456 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-838009-3-iscsi {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.422642 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.422838 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.423034 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.423228 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.423412 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.423623 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.423807 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.424032 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.424195 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.424394 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.424528 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.424687 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.424818 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.424940 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.425096 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.425237 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.425369 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.425511 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.425639 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.425800 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.425942 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.426072 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.426195 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-838009-3-iscsi {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.426324 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.426453 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.426582 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.426716 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.426845 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.426977 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.427134 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.427268 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.427418 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.427541 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.427669 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.427797 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.427946 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.428080 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.428212 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.428212 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.428652 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.428794 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.428999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.429143 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.429268 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.429524 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.429659 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.429861 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.430014 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.430148 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.430281 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.430403 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.430603 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.430836 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.430963 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.431086 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.431086 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.431086 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.431467 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.431599 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.431722 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.431844 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.432002 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.432142 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.432272 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-838009-3-iscsi {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.432395 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.432523 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.432658 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.432794 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.432932 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.433055 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.433177 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.433177 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.433425 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.433562 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.433693 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.433816 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.433937 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.434090 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.434219 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.434461 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.434587 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.434730 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.434864 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.434994 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.435127 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.435332 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.435461 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.435649 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.435783 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.435976 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.436122 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.436296 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.436424 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.436617 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.436757 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.436922 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.437062 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.437226 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.437353 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.437530 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.437663 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.437846 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.437984 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.438108 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.438228 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.438396 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.438705 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.438705 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.438964 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.439099 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.439229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.439362 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.439485 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.439699 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.439838 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.439838 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.440120 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.440252 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.440390 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.440514 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.440648 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.440779 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.440914 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.441038 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.441169 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.441319 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.441453 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.441624 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.441752 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.441926 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.442063 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.442230 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.442357 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.442532 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.442658 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.442835 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.442975 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.443136 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.443270 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.443436 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.443572 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.443752 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.443888 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.444097 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.444223 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.444398 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.444532 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.444702 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.444830 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.445006 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.445142 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.445310 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.445437 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.446140 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.446276 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.446544 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.446737 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.447017 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.447151 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.447339 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.447482 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.447639 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.447770 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.447977 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.448106 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.448285 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.448415 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.448590 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.448867 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.448995 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.449118 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.449250 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.449376 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.449510 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.449645 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.449855 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.449991 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.450123 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.450246 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.450383 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.450509 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.450631 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.450767 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.450931 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.451059 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.451232 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.451359 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.451533 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.451672 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.451832 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.452019 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.452145 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.452279 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.452442 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.452583 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.452757 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.452885 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.453075 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.453201 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.453381 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.453522 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.453686 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.453813 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.453989 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.454123 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.454306 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.454441 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.454644 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.454771 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.454971 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.455102 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.455298 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.455425 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.455862 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.456029 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.456210 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.456334 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.456543 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.456676 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.456801 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.456932 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.457116 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.457250 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.457446 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.457578 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.457756 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.457883 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.458067 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.458201 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.458376 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.458510 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.458685 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.458953 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.459084 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.459218 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.459342 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.459462 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.459583 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.459704 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.459948 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.460098 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.460224 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.460353 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.460529 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.460656 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.460842 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.460979 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.461157 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.461315 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.462063 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.462393 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.462541 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.462709 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.462867 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.463050 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.463187 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.463394 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.463563 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.463709 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.463856 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.464058 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.464186 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.464377 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.464515 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.464696 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.464830 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.465007 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.465137 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.465316 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.465451 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.465639 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.465777 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.465977 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.466118 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.466292 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.466427 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.466613 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.466738 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.466925 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.467050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:17:30.467239 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.467383 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.467552 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.467678 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.467864 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.468009 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.468211 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.468352 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.468545 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.468681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.468859 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.469129 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.469266 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.469405 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.469537 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.469661 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.469783 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.469905 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.470055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.470241 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.470377 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.470509 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.470664 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.470802 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.470969 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.471107 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.471273 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.471402 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.471601 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.471728 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.471867 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.472033 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.472192 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.472355 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.472510 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.472680 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.472821 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.473007 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.473138 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.473324 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.473451 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.473649 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.473777 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.473985 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.474111 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.474313 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.474440 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.474627 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.474753 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.474933 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.475060 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.475245 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.475372 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.475554 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.475682 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.475859 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.476009 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.476208 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.476346 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.476516 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.476652 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.476820 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.477132 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.477262 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.477616 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.477929 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.478056 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.478246 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.478595 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.478932 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.479248 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.479559 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.479883 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.480308 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.480570 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.480951 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.481291 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.481440 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.481633 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.481794 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.481967 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.482135 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.482300 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.482449 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.482626 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.482777 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.483054 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.483196 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.483390 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.483524 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.483709 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.483843 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.484046 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.484184 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.484352 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.484488 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.484660 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.484788 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.484966 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.485109 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.485275 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.485409 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.485584 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.485710 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.485886 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.486023 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.486188 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.486323 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.486491 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.486611 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.486794 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.486938 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.487117 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.487247 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.487426 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.487554 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.487730 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.487858 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.488055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.488182 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.488347 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.488482 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.488688 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.488817 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.488994 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.489264 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.489397 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.489520 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.489651 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.489786 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.489949 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.490077 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.490263 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.490473 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.490600 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.490730 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.490879 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.491006 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.491191 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.491329 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.491502 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.491627 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.491815 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.491959 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.492151 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.492292 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.492492 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.492620 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.492919 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.493246 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.493386 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.493560 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.493696 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.493885 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.494021 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.494198 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.494335 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.494520 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.494646 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.494823 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.494941 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.495136 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.495277 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.495473 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.495600 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.495794 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.495955 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.496143 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.496279 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.496467 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.496595 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.496780 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.496917 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.497097 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.497234 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.497405 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.497536 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.497717 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.497844 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.498029 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.498164 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.498341 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.498468 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.498655 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.498788 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.498963 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.499090 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.499350 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.499485 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.499607 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.499730 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.499862 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.500041 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.500201 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.500330 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.500530 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.500672 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.500807 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.500930 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.501109 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.501236 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.501416 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.501541 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.501746 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.501876 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.502054 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.502180 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.502362 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.502501 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.502673 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.502800 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.502984 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.503110 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.503291 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.503430 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.503602 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.503729 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.503927 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.504070 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.504238 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.504374 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.504547 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.504673 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.504859 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.504988 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.505167 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.505315 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.505480 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.505607 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.505785 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.505912 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.506097 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.506225 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.506406 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.506532 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.506707 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.506826 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.507010 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.507147 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.507320 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.507454 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.507640 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.507766 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.507969 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.508105 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.508784 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.509115 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.509461 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.509599 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.509741 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.509873 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.510018 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.510154 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.510325 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.510462 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.510664 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.510798 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.510931 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.511066 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.511234 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.511442 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.511569 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.511700 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.511871 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.512044 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.512198 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.512341 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.512511 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.512639 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.512830 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.512965 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.513137 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.513273 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.513448 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.513584 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.513755 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.513882 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.514061 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.514200 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.514379 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.514507 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.514690 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.514817 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.514995 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.515123 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.515307 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.515442 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.515616 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.515751 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.515964 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.516095 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.516279 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.516407 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.516599 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.516725 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.516903 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.517037 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.517213 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.517340 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.517523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.517665 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.517828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.517964 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.518137 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.518271 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.518452 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.518593 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.518793 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.519019 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.519146 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.519351 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.519620 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.519767 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.519929 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.520055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.520190 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.520314 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.520436 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.520608 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.520751 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.520944 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.521071 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.521249 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.521383 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.521569 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.521704 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.521886 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.522026 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.522193 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.522319 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.522497 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.522632 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.522798 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.522924 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.523105 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.523236 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.523409 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.523538 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.523694 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.524394 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.524625 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.524935 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.525104 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.525233 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.525428 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.525555 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.525743 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.525878 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.526079 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.526206 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.526400 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.526525 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.526705 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.526830 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.527014 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.527142 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.527318 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.527445 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.527639 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.527773 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.527958 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.528098 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.528261 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.528386 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.528564 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.528700 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.528866 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.528994 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.529206 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.529333 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.529507 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.529773 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.529901 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.530030 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.530155 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.530277 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.530432 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.530567 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.530752 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.530878 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.531076 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.531202 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.531375 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.531508 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.531675 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.531802 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.532003 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.532131 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.532307 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.532443 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.532615 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.532742 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.532921 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.533056 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.533225 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.533354 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.533532 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.533666 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.533840 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.533967 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.534148 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.534278 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.534454 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.534581 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.534755 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.535019 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.535147 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.535358 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.535485 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.535669 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.535796 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.536000 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.536130 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.536303 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.536442 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.536605 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.536735 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.536913 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.537048 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.537218 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.537356 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.537518 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.537645 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.537850 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.537994 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.538126 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.538258 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.538413 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.538543 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.538714 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.538851 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.539018 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.539145 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.539319 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.539466 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.539648 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.539976 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.540211 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.540339 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.540531 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.540661 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.540878 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.540998 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.541229 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.541471 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.541650 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.541779 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.541980 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.542108 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.542301 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.542428 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.542623 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.542751 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.542951 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.543080 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.543266 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.543391 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.543571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.543706 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.543881 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.544046 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.544215 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.544342 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.544519 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.544664 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.544822 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.544950 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.545128 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.545256 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.545436 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.545572 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.545737 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.545865 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.546038 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.546164 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.546341 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.546484 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.546644 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.546771 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.546962 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.547089 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.547268 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.547397 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.547571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.547698 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.547875 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.548034 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.548267 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.548403 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.548606 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.548735 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.548909 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.549047 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.549224 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.549351 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.549542 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.549676 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.549950 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.550088 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.550221 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.550344 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.550465 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.550587 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.550760 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.550886 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.551073 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.551224 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.551410 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.551544 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.551668 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.551799 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.551992 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.552133 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.552303 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.552431 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.552606 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.552743 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.552907 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.553042 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.553226 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.553361 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.553535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.553672 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.553844 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.553972 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.554165 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.554300 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.554484 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.554622 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.554818 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.554946 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.555143 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.555274 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.555448 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.555756 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.556020 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.556150 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.556344 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.556472 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.556660 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.556789 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.556971 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.557097 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.557282 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.557414 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.557593 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.557719 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.557900 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.558025 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.558208 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.558336 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.558513 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.558654 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.558817 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.558946 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.559123 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.559261 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.559426 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.559554 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.559735 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.559862 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.560136 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.560282 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.560409 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.560531 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.560661 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.560786 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.560952 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.561093 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.561259 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.561401 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.561594 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.561722 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.561914 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.562050 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.562226 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.562360 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.562541 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.562669 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.562849 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.562983 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.563157 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.563282 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.563463 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.563587 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.563772 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.563957 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.564105 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.564229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.564408 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.564535 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.564735 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.564868 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.565047 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.565173 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.565360 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.565488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.565687 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.565813 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.566008 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.566134 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.566307 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.566441 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.566626 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.566751 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.566949 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.567083 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.567252 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.567388 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.567562 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.567693 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.567853 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.568016 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.568196 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.568335 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.568498 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.568625 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.568815 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.568943 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.569134 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.569269 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.569452 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.569588 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.569771 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.569899 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.570184 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.570325 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.570450 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.570573 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.571255 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.571452 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.571787 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.572074 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.572205 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.572402 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.572529 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.572738 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.572875 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.573051 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.573179 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.573359 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.573487 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.573683 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.573819 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.574001 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.574134 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.574309 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.574433 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.574623 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.574756 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.574926 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.575051 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.575243 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.575368 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.575562 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.575690 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.575873 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.576017 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.576219 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.576367 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.576597 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.576724 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.576916 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.577042 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.577230 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.577357 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.577546 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.577674 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.577862 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.577988 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.578166 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.578299 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.578472 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.578608 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.578778 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.578904 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.579080 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.579215 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.579382 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.579509 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.579695 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.579820 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.580033 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.580307 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.580440 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.580562 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.580941 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.581062 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.581205 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.581343 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.581510 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.581638 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.581831 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.581958 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.582105 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.582243 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.582406 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.582544 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.582725 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.582853 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.583037 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.583173 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.583358 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.583495 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.583678 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.583958 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.584089 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.584288 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.584428 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.584605 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.584732 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.584910 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.585046 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.585212 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.585349 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.585519 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.585648 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.585834 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.585959 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.586148 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.586970 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.587107 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.587372 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.587499 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.587700 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.587837 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.588027 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.588155 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.588354 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.588491 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.588680 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.588818 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.588995 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.589123 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.589310 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.589493 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.589621 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.589814 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.589943 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.590128 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.590268 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.590535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.590657 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.590794 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.590927 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.591084 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.591219 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.591388 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.591525 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.591694 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.591837 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.592041 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.592180 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.592305 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.592442 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.592593 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.592743 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.592913 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.593042 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.593215 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.593375 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.593518 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.593705 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.593833 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.594023 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.594155 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.594345 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.594473 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.594656 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.594784 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.594985 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.595125 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.595304 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.595429 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.595622 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.595749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.595971 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.596114 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.596296 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.596423 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.596621 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.596748 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.596931 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.597067 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.597253 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.597382 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.597568 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.597696 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.597884 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.598022 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.598199 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.598327 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.598513 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.598640 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.598828 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.598955 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.599138 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.599265 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.599448 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.599582 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.599755 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.599909 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.600093 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.600222 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.600522 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.600669 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.600805 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.600935 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.601059 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.601221 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.601350 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.601548 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.601690 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.601882 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.602029 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.602303 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.602622 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.602771 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.602933 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.603068 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.603248 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.603375 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.603558 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.603700 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.603867 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.604042 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.604202 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.604339 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.604513 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.604652 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.604840 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.604975 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.605163 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.605292 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.605494 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.605633 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.605826 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.605961 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.606140 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.606270 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.606453 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.606582 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.606765 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.606901 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.607077 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.607205 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.607435 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.607563 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.608114 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.608244 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.608351 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.608492 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.608618 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.608740 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.608864 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.608987 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.609109 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.609241 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.609374 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.609499 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.609629 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.609754 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.609878 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.610009 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.610174 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.610302 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.610484 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.610747 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.610881 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.611016 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.611141 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.611264 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.611387 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.611510 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.611706 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.611836 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.612064 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.612207 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.612401 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.612527 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.612663 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.612796 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.612978 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.613107 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.613293 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.613420 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.613600 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.613809 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.613937 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.614124 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.614252 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.614452 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.614587 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.614767 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.614903 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.615091 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.615228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.615410 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.615552 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.615724 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.615859 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.616075 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.616217 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.616383 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.616522 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.616688 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.616815 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.616995 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.617130 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.617306 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.617441 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.617634 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.617957 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.618189 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.618329 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.618536 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.618671 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.618863 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.618992 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.619168 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.619306 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.619499 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.619699 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.619827 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.620068 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.620198 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.620385 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.620522 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.620781 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.620921 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.621047 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.621302 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.621449 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.621620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.621746 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.621943 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.622077 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.622278 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.622420 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.622616 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.622744 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.622875 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.623007 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.623173 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.623300 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.623422 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.623544 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.623706 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.623833 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.624030 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.624160 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.624337 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.624466 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.624639 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.624774 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.624946 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.625074 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.625252 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.625381 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.625576 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.625721 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.625880 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.626016 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.626184 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.626312 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.626485 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.626623 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.626794 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.626921 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.627097 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.627263 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.627403 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.627588 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.627716 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.627936 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.628067 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.628246 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.628386 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.628570 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.628699 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.628877 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.629002 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.629181 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.629317 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.629489 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.629617 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.629792 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.629919 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.630099 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.630240 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.630412 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.630538 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.630851 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.630990 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.631124 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.631248 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.631370 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.631492 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.631623 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.631747 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.631947 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.632079 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.632272 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.632399 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.632651 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.632800 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.632937 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.633061 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.633773 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.634256 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.634382 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.634988 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.635335 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.635461 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.635665 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.635793 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.636023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.636166 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.636356 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.636483 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.636666 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.636792 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.636974 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.637110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.637283 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.637410 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.637604 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.637730 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.637915 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.638050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.638224 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.638353 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.638532 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.638658 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.638838 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.638968 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.639147 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.639282 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.639455 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.639582 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.639762 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.639918 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.640093 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.640208 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.640401 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.640521 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.640708 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.640957 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.641978 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.642108 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.642294 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.642432 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.642609 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.642744 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.642937 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.643065 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.643257 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.643396 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.643572 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.643707 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.643885 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.644060 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.644224 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.644365 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.644536 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.644664 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.644845 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.644973 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.645154 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.645295 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.645462 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.645599 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.645779 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.645920 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.646117 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.646248 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.646439 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.646568 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.646746 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.646874 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.647076 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.647209 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.647397 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.647525 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.647711 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.647838 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.648074 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.648203 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.648390 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.648520 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.648703 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.649374 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.649610 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.649926 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.650247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.650452 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.650579 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.650794 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.650930 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.651191 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.651315 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.651437 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.651569 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.651744 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.651873 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.652093 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.652233 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.652421 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.652549 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.652721 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.652849 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.653048 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.653175 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.653332 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.653469 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.653641 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.653769 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.653948 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.654083 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.654251 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.654453 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.654586 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.654712 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.654835 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.654959 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.655135 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.655277 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.655439 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.655567 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.655742 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.655869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.656073 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.656219 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.656380 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.656518 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.656683 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.656819 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.656985 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.657114 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.657287 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.657451 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.657578 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.657775 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.657912 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.658172 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.658320 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.658475 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.658663 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.658791 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.658992 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.659121 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.659331 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.659458 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.659647 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.659775 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.659995 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.660177 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.660320 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.660445 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.660615 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.660751 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.660942 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.661202 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.661343 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.661467 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.661597 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.661734 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.661867 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.661991 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.662157 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.662286 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.662470 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.662608 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.662782 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.662908 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.663107 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.663240 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.663402 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.663529 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.663711 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.663837 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.664048 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.664178 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.664380 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.664512 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.664694 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.665005 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.665137 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.665314 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.665460 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.665641 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.665793 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.665967 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.666124 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.666259 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.666452 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.666582 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.666777 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.666904 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.667104 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.667248 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.667423 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.667551 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.667740 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.667870 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.668098 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.668236 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.668419 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.668554 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.668732 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.668857 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.669048 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.669184 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.669362 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.669496 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.669672 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.669811 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.669989 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.670117 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.670307 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.670433 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.670635 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.670762 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.670961 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.671088 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.671350 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.671479 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.671601 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.671726 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.671956 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.672089 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.672268 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.672396 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.672597 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.672736 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.672915 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.673049 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.673249 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.673381 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.673542 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.673680 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.673850 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.673977 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.674099 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 04:17:30.674244 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.674559 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.674876 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.675190 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.675509 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.675835 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.676181 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.676495 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.676805 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.677122 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.677434 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.677746 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.678060 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.678372 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.678685 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.678995 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.679304 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.679614 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.679943 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.680775 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.681099 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.681423 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.681737 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.682055 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.682370 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.682685 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.682997 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.683356 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.683678 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.684028 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.684363 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.684683 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.685107 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.685431 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.685760 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.686088 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.686412 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.686730 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.687067 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.687385 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.687706 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.688055 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.688377 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.688694 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.689010 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.689345 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.689690 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.690006 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.690339 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.690668 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.690995 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.691318 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.692453 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.692453 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.692714 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.692953 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.693268 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.693593 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.693917 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.694245 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.694576 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.694928 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.695250 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.696122 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.697048 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.697405 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.697567 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_db.sqlalchemy.engines [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:17:30.697734 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.698080 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.698422 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.698748 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.699093 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.699389 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:17:30.699642 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 04:17:30.723241 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG oslo_db.sqlalchemy.engines [None req-a15f19ac-9d33-4095-84e4-4a2710fd6619 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:17:30.761122 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.context [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1633d3c-e28c-4cff-8311-7e3f4477d0ce(cell1) {{(pid=102484) load_cells /opt/stack/nova/nova/context.py:464}} May 09 04:17:30.765455 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:17:30.767041 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:17:30.767843 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:17:30.769779 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:17:30.781132 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_db.sqlalchemy.engines [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:17:30.784349 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_db.sqlalchemy.engines [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:17:30.789325 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.context [None req-a15f19ac-9d33-4095-84e4-4a2710fd6619 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1633d3c-e28c-4cff-8311-7e3f4477d0ce(cell1) {{(pid=102483) load_cells /opt/stack/nova/nova/context.py:464}} May 09 04:17:30.794922 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG oslo_concurrency.lockutils [None req-a15f19ac-9d33-4095-84e4-4a2710fd6619 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:17:30.796549 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG oslo_concurrency.lockutils [None req-a15f19ac-9d33-4095-84e4-4a2710fd6619 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:17:30.797347 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG oslo_concurrency.lockutils [None req-a15f19ac-9d33-4095-84e4-4a2710fd6619 None None] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:17:30.799285 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG oslo_concurrency.lockutils [None req-a15f19ac-9d33-4095-84e4-4a2710fd6619 None None] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:17:30.812881 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG oslo_db.sqlalchemy.engines [None req-a15f19ac-9d33-4095-84e4-4a2710fd6619 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:17:30.816282 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG oslo_db.sqlalchemy.engines [None req-a15f19ac-9d33-4095-84e4-4a2710fd6619 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:17:30.941928 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_db.sqlalchemy.engines [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:17:30.975774 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG oslo_db.sqlalchemy.engines [None req-a15f19ac-9d33-4095-84e4-4a2710fd6619 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:17:31.279721 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: WARNING keystonemiddleware.auth_token [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 04:17:31.287130 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: WARNING keystonemiddleware.auth_token [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 04:17:31.294994 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: WARNING keystonemiddleware.auth_token [None req-a15f19ac-9d33-4095-84e4-4a2710fd6619 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 04:17:31.302389 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: WARNING keystonemiddleware.auth_token [None req-a15f19ac-9d33-4095-84e4-4a2710fd6619 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 04:17:31.629811 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: WARNING keystonemiddleware.auth_token [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 04:17:31.636568 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: WARNING keystonemiddleware.auth_token [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 04:17:31.642595 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570627909c0 pid: 102484 (default app) May 09 04:17:31.644683 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:17:31.645846 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001739 May 09 04:17:31.646261 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Mon May 9 04:17:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:17:31.646398 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: WARNING keystonemiddleware.auth_token [None req-a15f19ac-9d33-4095-84e4-4a2710fd6619 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 04:17:31.652544 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: WARNING keystonemiddleware.auth_token [None req-a15f19ac-9d33-4095-84e4-4a2710fd6619 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 04:17:31.657656 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570627909c0 pid: 102483 (default app) May 09 04:18:50.190701 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:18:50.192338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 May 09 04:18:50.192987 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 04:18:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:18:50.635526 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-eb8d0240-ef81-4db8-909f-33c4086daa82 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:18:50.665566 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-eb8d0240-ef81-4db8-909f-33c4086daa82 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.465076 May 09 04:18:50.666459 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Mon May 9 04:18:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:18:52.984969 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:18:52.985960 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-057d1a6b-b09b-429f-b3c8-cfe8cc53d113 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 09 04:18:52.986535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 04:18:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:18:53.044791 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-aa410a7d-a489-4763-ab94-c532c01a6adc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:18:53.064144 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 04:18:53.064144 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: warnings.warn(msg) May 09 04:18:53.095070 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-aa410a7d-a489-4763-ab94-c532c01a6adc admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102626 May 09 04:18:53.095639 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 04:18:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:18:53.313972 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-3fb63cbe-9d7b-4424-939e-234cc588108e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:18:53.316291 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 04:18:53.316291 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: warnings.warn(msg) May 09 04:18:53.364779 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-3fb63cbe-9d7b-4424-939e-234cc588108e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.261019 May 09 04:18:53.365616 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 9 04:18:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:18:55.615959 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-aa410a7d-a489-4763-ab94-c532c01a6adc admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:18:55.619146 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-aa410a7d-a489-4763-ab94-c532c01a6adc admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 09 04:18:55.619146 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 04:18:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:18:55.739053 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-0e790beb-898d-4dbf-b798-e341e28fe247 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "id": "d1", "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:18:55.760942 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 04:18:55.760942 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: warnings.warn(msg) May 09 04:18:55.779144 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-0e790beb-898d-4dbf-b798-e341e28fe247 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155355 May 09 04:18:55.779734 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 04:18:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:18:55.792494 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-3e7352c0-34c6-4d09-b60a-3a1abd7abdf1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:18:55.794006 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 04:18:55.794006 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: warnings.warn(msg) May 09 04:18:55.825705 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-3e7352c0-34c6-4d09-b60a-3a1abd7abdf1 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036960 May 09 04:18:55.826333 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 9 04:18:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:18:58.153716 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-0e790beb-898d-4dbf-b798-e341e28fe247 admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:18:58.158519 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-0e790beb-898d-4dbf-b798-e341e28fe247 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 May 09 04:18:58.158519 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 04:18:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:18:58.216246 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-3ed59a4b-60d2-421c-b771-5372454a699d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "vcpus": 1, "swap": 0, "name": "ds1G", "disk": 10}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:18:58.235147 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-3ed59a4b-60d2-421c-b771-5372454a699d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073808 May 09 04:18:58.235871 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 04:18:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:18:58.248805 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-fdc18bd0-a318-42f7-a18f-617a54ced7db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:18:58.271471 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-fdc18bd0-a318-42f7-a18f-617a54ced7db admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026889 May 09 04:18:58.272965 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 9 04:18:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:19:00.557248 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-3ed59a4b-60d2-421c-b771-5372454a699d admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:00.558372 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-3ed59a4b-60d2-421c-b771-5372454a699d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 May 09 04:19:00.558868 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 04:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:00.620748 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-e1933ffc-3b1c-4a63-8106-ce2f0e1179cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:00.642211 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-e1933ffc-3b1c-4a63-8106-ce2f0e1179cd admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076965 May 09 04:19:00.642694 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 04:19:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 04:19:00.654749 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-265167f2-1610-4dd1-b9f3-71eb5bb317aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:00.680952 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-265167f2-1610-4dd1-b9f3-71eb5bb317aa admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029991 May 09 04:19:00.681552 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 9 04:19:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:19:02.974737 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-e1933ffc-3b1c-4a63-8106-ce2f0e1179cd admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:02.976010 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-e1933ffc-3b1c-4a63-8106-ce2f0e1179cd admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001634 May 09 04:19:02.976584 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 04:19:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:03.034968 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-67ff8816-412e-4c79-a75d-a540d85bddcf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:03.052617 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-67ff8816-412e-4c79-a75d-a540d85bddcf admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070546 May 09 04:19:03.061075 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 04:19:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:19:03.066004 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-60b3411f-99fb-4d88-a0b5-e1165097ec7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:03.090032 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-60b3411f-99fb-4d88-a0b5-e1165097ec7c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027689 May 09 04:19:03.090607 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Mon May 9 04:19:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:19:05.396308 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-67ff8816-412e-4c79-a75d-a540d85bddcf admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:05.398276 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-67ff8816-412e-4c79-a75d-a540d85bddcf admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002198 May 09 04:19:05.400189 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 04:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:05.462560 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-4a8e22e6-3681-4ff5-aa6e-1fec591e5c2f admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:05.489771 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-4a8e22e6-3681-4ff5-aa6e-1fec591e5c2f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085105 May 09 04:19:05.490851 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Mon May 9 04:19:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:19:07.793547 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-67ff8816-412e-4c79-a75d-a540d85bddcf admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:07.794559 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-67ff8816-412e-4c79-a75d-a540d85bddcf admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 09 04:19:07.794969 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 04:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:07.864907 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-2d1b8f25-5fda-47d3-bb02-b3ce04a9d8d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "id": "1", "name": "m1.tiny", "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:07.882942 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-2d1b8f25-5fda-47d3-bb02-b3ce04a9d8d7 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081906 May 09 04:19:07.883489 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 04:19:07 2022] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:19:07.895379 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-822adc00-ce22-48c4-a9a1-cc11f6da7c3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:07.920912 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-822adc00-ce22-48c4-a9a1-cc11f6da7c3a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029178 May 09 04:19:07.921668 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 9 04:19:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:19:10.185163 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-2d1b8f25-5fda-47d3-bb02-b3ce04a9d8d7 admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:10.186220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-2d1b8f25-5fda-47d3-bb02-b3ce04a9d8d7 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 May 09 04:19:10.186635 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 04:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:10.253678 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-d32c9b49-33bd-46e0-8200-6d2439f068cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 1, "name": "m1.small"}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:10.275021 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-d32c9b49-33bd-46e0-8200-6d2439f068cd admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082090 May 09 04:19:10.276119 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 04:19:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:19:10.288223 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-d8cfe344-3db8-4d6a-9743-25c2d5f93922 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:10.310487 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-d8cfe344-3db8-4d6a-9743-25c2d5f93922 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026516 May 09 04:19:10.311052 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 9 04:19:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:19:13.002667 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-d32c9b49-33bd-46e0-8200-6d2439f068cd admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:13.003673 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-d32c9b49-33bd-46e0-8200-6d2439f068cd admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 09 04:19:13.004299 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 04:19:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:13.064632 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-b809c7b7-f011-4378-a011-a4b0e91fad50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0}} {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:13.082920 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-b809c7b7-f011-4378-a011-a4b0e91fad50 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072039 May 09 04:19:13.083552 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 04:19:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 04:19:13.095515 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-a325e01e-2a1d-4b0b-b9af-220a39caa085 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:13.118408 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-a325e01e-2a1d-4b0b-b9af-220a39caa085 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026554 May 09 04:19:13.118981 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 9 04:19:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:19:15.373248 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-b809c7b7-f011-4378-a011-a4b0e91fad50 admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:15.374270 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-b809c7b7-f011-4378-a011-a4b0e91fad50 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 09 04:19:15.374687 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 04:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:15.437014 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-81c41b8b-2e16-42cf-8dad-7e409ed1bfe9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:15.454280 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-81c41b8b-2e16-42cf-8dad-7e409ed1bfe9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073195 May 09 04:19:15.454827 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 04:19:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 04:19:15.467271 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-d0af4b53-f1ca-40e2-9aa8-62f5e2dfbfb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:15.490202 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-d0af4b53-f1ca-40e2-9aa8-62f5e2dfbfb9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026422 May 09 04:19:15.490966 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 9 04:19:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:19:17.783454 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-81c41b8b-2e16-42cf-8dad-7e409ed1bfe9 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:17.784511 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-81c41b8b-2e16-42cf-8dad-7e409ed1bfe9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 May 09 04:19:17.785197 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 04:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:17.848202 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-1745eb70-7934-47e0-a78f-625f5e3c6cd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0}} {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:17.866841 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-1745eb70-7934-47e0-a78f-625f5e3c6cd2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075130 May 09 04:19:17.867498 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Mon May 9 04:19:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:19:17.879146 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-d05f0edd-d22f-44e1-b5be-aa5c5e67c5cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:17.904454 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-d05f0edd-d22f-44e1-b5be-aa5c5e67c5cf admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028793 May 09 04:19:17.905329 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Mon May 9 04:19:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:19:42.117811 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-1745eb70-7934-47e0-a78f-625f5e3c6cd2 admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:42.118814 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-1745eb70-7934-47e0-a78f-625f5e3c6cd2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 09 04:19:42.119232 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 04:19:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:42.175459 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-6453d08a-be85-47b5-bc2b-fbcabe7cca17 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:42.194301 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-6453d08a-be85-47b5-bc2b-fbcabe7cca17 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069063 May 09 04:19:42.194824 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Mon May 9 04:19:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:19:43.192823 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-1745eb70-7934-47e0-a78f-625f5e3c6cd2 admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:43.193853 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-1745eb70-7934-47e0-a78f-625f5e3c6cd2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 09 04:19:43.194252 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 04:19:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:43.404656 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-ce72e2a4-bf38-412a-834e-38db7cdeb0cd admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:43.410209 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.wsgi [None req-ce72e2a4-bf38-412a-834e-38db7cdeb0cd admin admin] HTTP exception thrown: Flavor 42 could not be found. May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-ce72e2a4-bf38-412a-834e-38db7cdeb0cd admin admin] Request method failure captured: May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Accept: application/json May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Accept-Encoding: gzip, deflate May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Connection: keep-alive May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Content-Length: 0 May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Host: 10.222.0.44 May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Openstack-Api-Version: compute 2.90 May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Openstack-System-Scope: None May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: User-Agent: python-novaclient May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Auth-Token: gAAAAABieJZfNzJT62djD7De_3OZRrx7fkKgXqKMz5Sjjuwp3g1yiiZmNa8TLB7DfhiAwX2DFIlfeVzNEQorzA3zU-SzrVD8UC7mjO6XWKV30d96o_EeyfJQN-7vbrCTs8rqouSpYiaSQI1DIh5C-JsgbBXalQLawpjJgrDK6pBY9Osd5z8mvL0 May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Domain-Id: None May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Domain-Name: None May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Identity-Status: Confirmed May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Is-Admin-Project: True May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Openstack-Nova-Api-Version: 2.90 May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Project-Domain-Id: default May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Project-Domain-Name: Default May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Project-Id: 528420bd736843dc87d64954f4596bbd May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Project-Name: admin May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Role: admin,reader,member May 09 04:19:43.414228 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Roles: admin,reader,member May 09 04:19:43.415954 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/528420bd736843dc87d64954f4596bbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/528420bd736843dc87d64954f4596bbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/528420bd736843dc87d64954f4596bbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_528420bd736843dc87d64954f4596bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:19:43.415954 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Tenant: admin May 09 04:19:43.415954 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Tenant-Id: 528420bd736843dc87d64954f4596bbd May 09 04:19:43.415954 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Tenant-Name: admin May 09 04:19:43.415954 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User: admin May 09 04:19:43.415954 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User-Domain-Id: default May 09 04:19:43.415954 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User-Domain-Name: Default May 09 04:19:43.415954 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User-Id: c49606bc956845408ea8db21c53f217a May 09 04:19:43.415954 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User-Name: admin May 09 04:19:43.415954 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: method: > May 09 04:19:43.415954 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: exception: Flavor 42 could not be found. May 09 04:19:43.415954 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: action_args: {'id': '42'} May 09 04:19:43.415954 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:19:43.415954 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:19:43.416999 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:43.418309 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-ce72e2a4-bf38-412a-834e-38db7cdeb0cd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:19:43.419562 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-ce72e2a4-bf38-412a-834e-38db7cdeb0cd admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.068248 May 09 04:19:43.419562 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Mon May 9 04:19:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 04:19:43.425633 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-906c2876-b03f-4cd3-8dd1-ebb4b1e60a08 admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:43.449033 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-906c2876-b03f-4cd3-8dd1-ebb4b1e60a08 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027012 May 09 04:19:43.449575 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 9 04:19:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:19:43.467018 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-3b8e0861-12e0-481f-b583-f22e0f0346e8 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:43.488270 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-3b8e0861-12e0-481f-b583-f22e0f0346e8 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024743 May 09 04:19:43.488792 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 9 04:19:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:19:43.497793 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-7b0b1bae-bef3-4115-9122-9ec86da0e51f admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:43.503256 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.wsgi [None req-7b0b1bae-bef3-4115-9122-9ec86da0e51f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-7b0b1bae-bef3-4115-9122-9ec86da0e51f admin admin] Request method failure captured: May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Accept: application/json May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Accept-Encoding: gzip, deflate May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Connection: keep-alive May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Content-Length: 0 May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Host: 10.222.0.44 May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Openstack-Api-Version: compute 2.90 May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Openstack-System-Scope: None May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: User-Agent: python-novaclient May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Auth-Token: gAAAAABieJZfNzJT62djD7De_3OZRrx7fkKgXqKMz5Sjjuwp3g1yiiZmNa8TLB7DfhiAwX2DFIlfeVzNEQorzA3zU-SzrVD8UC7mjO6XWKV30d96o_EeyfJQN-7vbrCTs8rqouSpYiaSQI1DIh5C-JsgbBXalQLawpjJgrDK6pBY9Osd5z8mvL0 May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Domain-Id: None May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Domain-Name: None May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Identity-Status: Confirmed May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Is-Admin-Project: True May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Openstack-Nova-Api-Version: 2.90 May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Project-Domain-Id: default May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Project-Domain-Name: Default May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Project-Id: 528420bd736843dc87d64954f4596bbd May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Project-Name: admin May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Role: admin,reader,member May 09 04:19:43.506523 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Roles: admin,reader,member May 09 04:19:43.508023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/528420bd736843dc87d64954f4596bbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/528420bd736843dc87d64954f4596bbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/528420bd736843dc87d64954f4596bbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_528420bd736843dc87d64954f4596bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:19:43.508023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Tenant: admin May 09 04:19:43.508023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Tenant-Id: 528420bd736843dc87d64954f4596bbd May 09 04:19:43.508023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Tenant-Name: admin May 09 04:19:43.508023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User: admin May 09 04:19:43.508023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User-Domain-Id: default May 09 04:19:43.508023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User-Domain-Name: Default May 09 04:19:43.508023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User-Id: c49606bc956845408ea8db21c53f217a May 09 04:19:43.508023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User-Name: admin May 09 04:19:43.508023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: method: > May 09 04:19:43.508023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: exception: Flavor 42 could not be found. May 09 04:19:43.508023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: action_args: {'id': '42'} May 09 04:19:43.508023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:19:43.508023 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:19:43.508828 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:43.510535 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-7b0b1bae-bef3-4115-9122-9ec86da0e51f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:19:43.511773 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-7b0b1bae-bef3-4115-9122-9ec86da0e51f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014031 May 09 04:19:43.511773 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Mon May 9 04:19:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 09 04:19:44.394278 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-3b8e0861-12e0-481f-b583-f22e0f0346e8 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:44.395279 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-3b8e0861-12e0-481f-b583-f22e0f0346e8 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 09 04:19:44.395676 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 04:19:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:44.583265 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-c6724eab-f3af-443f-a2cb-b9d05ade64da admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:44.588566 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.wsgi [None req-c6724eab-f3af-443f-a2cb-b9d05ade64da admin admin] HTTP exception thrown: Flavor 84 could not be found. May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-c6724eab-f3af-443f-a2cb-b9d05ade64da admin admin] Request method failure captured: May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Accept: application/json May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Accept-Encoding: gzip, deflate May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Connection: keep-alive May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Content-Length: 0 May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Host: 10.222.0.44 May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Openstack-Api-Version: compute 2.90 May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Openstack-System-Scope: None May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: User-Agent: python-novaclient May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Auth-Token: gAAAAABieJZgk6oqTkngtU2KFRFgww7O-rqFAzKF8SVmSP07gSOQcpXtesg8TmzsHhXQ7-9BWUDQvG8lTBw4u-o-mNjElXBMNaQ8EoJjJjenTiSNS3DX1bLOOjc35KYU4u804CasSyjHw0lVsjqr28lcPXPDbjGRF2rvj6L58Vjy4Liy0EisaNU May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Domain-Id: None May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Domain-Name: None May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Identity-Status: Confirmed May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Is-Admin-Project: True May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Openstack-Nova-Api-Version: 2.90 May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Project-Domain-Id: default May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Project-Domain-Name: Default May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Project-Id: 528420bd736843dc87d64954f4596bbd May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Project-Name: admin May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Role: admin,reader,member May 09 04:19:44.590055 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Roles: admin,reader,member May 09 04:19:44.591571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/528420bd736843dc87d64954f4596bbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/528420bd736843dc87d64954f4596bbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/528420bd736843dc87d64954f4596bbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_528420bd736843dc87d64954f4596bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:19:44.591571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Tenant: admin May 09 04:19:44.591571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Tenant-Id: 528420bd736843dc87d64954f4596bbd May 09 04:19:44.591571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Tenant-Name: admin May 09 04:19:44.591571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User: admin May 09 04:19:44.591571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User-Domain-Id: default May 09 04:19:44.591571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User-Domain-Name: Default May 09 04:19:44.591571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User-Id: c49606bc956845408ea8db21c53f217a May 09 04:19:44.591571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User-Name: admin May 09 04:19:44.591571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: method: > May 09 04:19:44.591571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: exception: Flavor 84 could not be found. May 09 04:19:44.591571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: action_args: {'id': '84'} May 09 04:19:44.591571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:19:44.591571 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:19:44.592620 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:44.594220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-c6724eab-f3af-443f-a2cb-b9d05ade64da admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:19:44.595478 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-c6724eab-f3af-443f-a2cb-b9d05ade64da admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059390 May 09 04:19:44.595478 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Mon May 9 04:19:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 04:19:44.602047 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-875a0740-369b-4fe5-9a6b-c42a2b2c4c69 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:44.616216 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-875a0740-369b-4fe5-9a6b-c42a2b2c4c69 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018471 May 09 04:19:44.616685 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 9 04:19:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:19:44.625868 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-0bc8f2e5-f469-4819-ae0d-fd0abbe2554f admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:44.639231 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-0bc8f2e5-f469-4819-ae0d-fd0abbe2554f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016866 May 09 04:19:44.639745 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 9 04:19:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:19:44.648769 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-09cf1b95-6ae6-4103-bcfe-6e74e9d73fc2 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:44.654041 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.wsgi [None req-09cf1b95-6ae6-4103-bcfe-6e74e9d73fc2 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-09cf1b95-6ae6-4103-bcfe-6e74e9d73fc2 admin admin] Request method failure captured: May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Accept: application/json May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Accept-Encoding: gzip, deflate May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Connection: keep-alive May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Content-Length: 0 May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Host: 10.222.0.44 May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Openstack-Api-Version: compute 2.90 May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Openstack-System-Scope: None May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: User-Agent: python-novaclient May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Auth-Token: gAAAAABieJZgk6oqTkngtU2KFRFgww7O-rqFAzKF8SVmSP07gSOQcpXtesg8TmzsHhXQ7-9BWUDQvG8lTBw4u-o-mNjElXBMNaQ8EoJjJjenTiSNS3DX1bLOOjc35KYU4u804CasSyjHw0lVsjqr28lcPXPDbjGRF2rvj6L58Vjy4Liy0EisaNU May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Domain-Id: None May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Domain-Name: None May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Identity-Status: Confirmed May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Is-Admin-Project: True May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Openstack-Nova-Api-Version: 2.90 May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Project-Domain-Id: default May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Project-Domain-Name: Default May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Project-Id: 528420bd736843dc87d64954f4596bbd May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Project-Name: admin May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Role: admin,reader,member May 09 04:19:44.655564 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Roles: admin,reader,member May 09 04:19:44.657135 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/528420bd736843dc87d64954f4596bbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/528420bd736843dc87d64954f4596bbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/528420bd736843dc87d64954f4596bbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_528420bd736843dc87d64954f4596bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:19:44.657135 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Tenant: admin May 09 04:19:44.657135 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Tenant-Id: 528420bd736843dc87d64954f4596bbd May 09 04:19:44.657135 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Tenant-Name: admin May 09 04:19:44.657135 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User: admin May 09 04:19:44.657135 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User-Domain-Id: default May 09 04:19:44.657135 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User-Domain-Name: Default May 09 04:19:44.657135 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User-Id: c49606bc956845408ea8db21c53f217a May 09 04:19:44.657135 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User-Name: admin May 09 04:19:44.657135 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: method: > May 09 04:19:44.657135 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: exception: Flavor 84 could not be found. May 09 04:19:44.657135 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: action_args: {'id': '84'} May 09 04:19:44.657135 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:19:44.657135 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:19:44.658110 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:44.659589 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-09cf1b95-6ae6-4103-bcfe-6e74e9d73fc2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:19:44.660862 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-09cf1b95-6ae6-4103-bcfe-6e74e9d73fc2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011793 May 09 04:19:44.660862 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Mon May 9 04:19:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 04:19:45.544653 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-0bc8f2e5-f469-4819-ae0d-fd0abbe2554f admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:45.545738 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-0bc8f2e5-f469-4819-ae0d-fd0abbe2554f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 09 04:19:45.546232 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 04:19:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:45.736956 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-52f6d733-949c-4f06-bbdb-de62f4df512e admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:45.742696 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.wsgi [None req-52f6d733-949c-4f06-bbdb-de62f4df512e admin admin] HTTP exception thrown: Flavor 451 could not be found. May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-52f6d733-949c-4f06-bbdb-de62f4df512e admin admin] Request method failure captured: May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Accept: application/json May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Accept-Encoding: gzip, deflate May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Connection: keep-alive May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Content-Length: 0 May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Host: 10.222.0.44 May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Openstack-Api-Version: compute 2.90 May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Openstack-System-Scope: None May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: User-Agent: python-novaclient May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Auth-Token: gAAAAABieJZhLDKKUyPtm2wJTo1v3TEMTh3tnJXS4nlJensHO-V-aFE5X-nyaCNLFLGu3eHs13jxytvXr58_B5Gv67noXgYU4M_bkmAp3m35ddqQjHtDjPnogqLDKdxPMn1q_yvwjkasBsHrv-GbW2CgsDwLZW81RdAV0XFQi0KLBx9Eqf0c6zo May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Domain-Id: None May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Domain-Name: None May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Identity-Status: Confirmed May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Is-Admin-Project: True May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Openstack-Nova-Api-Version: 2.90 May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Project-Domain-Id: default May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Project-Domain-Name: Default May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Project-Id: 528420bd736843dc87d64954f4596bbd May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Project-Name: admin May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Role: admin,reader,member May 09 04:19:45.744229 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Roles: admin,reader,member May 09 04:19:45.745869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/528420bd736843dc87d64954f4596bbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/528420bd736843dc87d64954f4596bbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/528420bd736843dc87d64954f4596bbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_528420bd736843dc87d64954f4596bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:19:45.745869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Tenant: admin May 09 04:19:45.745869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Tenant-Id: 528420bd736843dc87d64954f4596bbd May 09 04:19:45.745869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-Tenant-Name: admin May 09 04:19:45.745869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User: admin May 09 04:19:45.745869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User-Domain-Id: default May 09 04:19:45.745869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User-Domain-Name: Default May 09 04:19:45.745869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User-Id: c49606bc956845408ea8db21c53f217a May 09 04:19:45.745869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: X-User-Name: admin May 09 04:19:45.745869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: method: > May 09 04:19:45.745869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: exception: Flavor 451 could not be found. May 09 04:19:45.745869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: action_args: {'id': '451'} May 09 04:19:45.745869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:19:45.745869 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:19:45.746681 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: ERROR nova.api.openstack.wsgi May 09 04:19:45.748050 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-52f6d733-949c-4f06-bbdb-de62f4df512e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:19:45.749284 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-52f6d733-949c-4f06-bbdb-de62f4df512e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059865 May 09 04:19:45.749284 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 9 04:19:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 04:19:45.755199 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-38a03e93-dd1b-4cbf-95e1-1a37bf5f1219 admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:45.769901 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-38a03e93-dd1b-4cbf-95e1-1a37bf5f1219 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018190 May 09 04:19:45.770466 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 9 04:19:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:19:45.780780 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-cadc8294-b5f5-4136-9684-ef95dc4ce698 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:45.795084 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-cadc8294-b5f5-4136-9684-ef95dc4ce698 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017883 May 09 04:19:45.795611 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Mon May 9 04:19:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:19:45.805066 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-26e4487a-7444-48f7-911b-050ed1dd899c admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:45.810277 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.wsgi [None req-26e4487a-7444-48f7-911b-050ed1dd899c admin admin] HTTP exception thrown: Flavor 451 could not be found. May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-26e4487a-7444-48f7-911b-050ed1dd899c admin admin] Request method failure captured: May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Accept: application/json May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Accept-Encoding: gzip, deflate May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Connection: keep-alive May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Content-Length: 0 May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Host: 10.222.0.44 May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Openstack-Api-Version: compute 2.90 May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Openstack-System-Scope: None May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: User-Agent: python-novaclient May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Auth-Token: gAAAAABieJZhLDKKUyPtm2wJTo1v3TEMTh3tnJXS4nlJensHO-V-aFE5X-nyaCNLFLGu3eHs13jxytvXr58_B5Gv67noXgYU4M_bkmAp3m35ddqQjHtDjPnogqLDKdxPMn1q_yvwjkasBsHrv-GbW2CgsDwLZW81RdAV0XFQi0KLBx9Eqf0c6zo May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Domain-Id: None May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Domain-Name: None May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Identity-Status: Confirmed May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Is-Admin-Project: True May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Openstack-Nova-Api-Version: 2.90 May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Project-Domain-Id: default May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Project-Domain-Name: Default May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Project-Id: 528420bd736843dc87d64954f4596bbd May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Project-Name: admin May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Role: admin,reader,member May 09 04:19:45.811749 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Roles: admin,reader,member May 09 04:19:45.813338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/528420bd736843dc87d64954f4596bbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/528420bd736843dc87d64954f4596bbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/528420bd736843dc87d64954f4596bbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_528420bd736843dc87d64954f4596bbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:19:45.813338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Tenant: admin May 09 04:19:45.813338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Tenant-Id: 528420bd736843dc87d64954f4596bbd May 09 04:19:45.813338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-Tenant-Name: admin May 09 04:19:45.813338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User: admin May 09 04:19:45.813338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User-Domain-Id: default May 09 04:19:45.813338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User-Domain-Name: Default May 09 04:19:45.813338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User-Id: c49606bc956845408ea8db21c53f217a May 09 04:19:45.813338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: X-User-Name: admin May 09 04:19:45.813338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: method: > May 09 04:19:45.813338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: exception: Flavor 451 could not be found. May 09 04:19:45.813338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: action_args: {'id': '451'} May 09 04:19:45.813338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:19:45.813338 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:19:45.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: ERROR nova.api.openstack.wsgi May 09 04:19:45.815488 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-26e4487a-7444-48f7-911b-050ed1dd899c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:19:45.816763 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-26e4487a-7444-48f7-911b-050ed1dd899c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011773 May 09 04:19:45.816763 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 9 04:19:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 04:19:46.696688 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-cadc8294-b5f5-4136-9684-ef95dc4ce698 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:46.697684 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-cadc8294-b5f5-4136-9684-ef95dc4ce698 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 09 04:19:46.698074 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 04:19:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:46.886947 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-afcfa525-8611-4013-a001-829640018c4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:46.903871 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-afcfa525-8611-4013-a001-829640018c4f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067568 May 09 04:19:46.904412 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Mon May 9 04:19:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:19:47.806095 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-cadc8294-b5f5-4136-9684-ef95dc4ce698 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:47.807128 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-cadc8294-b5f5-4136-9684-ef95dc4ce698 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 09 04:19:47.807524 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 04:19:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:47.995247 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-6a01d011-f4a8-4aba-8923-a94019d69750 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:48.012797 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-6a01d011-f4a8-4aba-8923-a94019d69750 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067912 May 09 04:19:48.013287 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Mon May 9 04:19:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:19:48.896790 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-cadc8294-b5f5-4136-9684-ef95dc4ce698 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:48.897827 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-cadc8294-b5f5-4136-9684-ef95dc4ce698 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 May 09 04:19:48.898250 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 04:19:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:49.085220 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-16065762-47ce-49da-81de-fcfab75585a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:49.102764 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-16065762-47ce-49da-81de-fcfab75585a3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067460 May 09 04:19:49.103298 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Mon May 9 04:19:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:19:49.993596 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-cadc8294-b5f5-4136-9684-ef95dc4ce698 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:49.994598 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-cadc8294-b5f5-4136-9684-ef95dc4ce698 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 09 04:19:49.994993 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 04:19:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:50.182739 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-ff479848-d403-4801-86dc-0ae03c00f143 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:19:50.200531 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-ff479848-d403-4801-86dc-0ae03c00f143 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067998 May 09 04:19:50.201066 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Mon May 9 04:19:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:19:51.092713 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-cadc8294-b5f5-4136-9684-ef95dc4ce698 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:51.094261 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-cadc8294-b5f5-4136-9684-ef95dc4ce698 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002165 May 09 04:19:51.094857 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 04:19:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:19:51.298373 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-99293000-d580-4ed3-84f5-99d801c0d09c admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:19:51.317513 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-99293000-d580-4ed3-84f5-99d801c0d09c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069591 May 09 04:19:51.318595 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Mon May 9 04:19:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:20:53.806262 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-cadc8294-b5f5-4136-9684-ef95dc4ce698 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:20:53.807830 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-cadc8294-b5f5-4136-9684-ef95dc4ce698 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002334 May 09 04:20:53.808513 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Mon May 9 04:20:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:20:53.873389 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-16622b65-feb2-4ce6-9a12-cd0c07b17852 admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:20:53.893992 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-16622b65-feb2-4ce6-9a12-cd0c07b17852 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078973 May 09 04:20:53.894536 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Mon May 9 04:20:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:20:53.918599 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-266660e9-66a1-4cab-8686-c07276454e67 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:20:53.927482 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-266660e9-66a1-4cab-8686-c07276454e67 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013303 May 09 04:20:53.928048 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Mon May 9 04:20:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:20:53.939490 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-bd14fbcc-b1c0-4055-bd66-abd270f9718e admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:20:53.948584 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-bd14fbcc-b1c0-4055-bd66-abd270f9718e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012251 May 09 04:20:53.949123 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Mon May 9 04:20:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:20:53.961253 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-4df2412c-f7c9-41cc-b490-d069f3156339 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:20:53.969187 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-4df2412c-f7c9-41cc-b490-d069f3156339 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012341 May 09 04:20:53.969711 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Mon May 9 04:20:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:20:53.982001 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-10a1456b-857c-4c28-8621-a73211b67e4e admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:20:53.990439 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-10a1456b-857c-4c28-8621-a73211b67e4e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012152 May 09 04:20:53.990964 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Mon May 9 04:20:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:24:12.953303 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-4df2412c-f7c9-41cc-b490-d069f3156339 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:24:12.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-4df2412c-f7c9-41cc-b490-d069f3156339 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 May 09 04:24:12.954794 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 04:24:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:24:13.234922 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-30d33119-b52d-42fb-ab24-b05e1064f26c admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:24:13.236143 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 04:24:13.236143 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: warnings.warn(msg) May 09 04:24:13.237409 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-30d33119-b52d-42fb-ab24-b05e1064f26c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:24:13.237852 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-30d33119-b52d-42fb-ab24-b05e1064f26c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:24:13.238645 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-30d33119-b52d-42fb-ab24-b05e1064f26c admin admin] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:24:13.239078 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-30d33119-b52d-42fb-ab24-b05e1064f26c admin admin] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:24:13.273000 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-30d33119-b52d-42fb-ab24-b05e1064f26c admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150846 May 09 04:24:13.273566 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 9 04:24:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:24:14.177381 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-4df2412c-f7c9-41cc-b490-d069f3156339 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:24:14.178388 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-4df2412c-f7c9-41cc-b490-d069f3156339 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 09 04:24:14.178948 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 04:24:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:24:14.367198 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-eb629361-0c2e-4562-a923-27e2a75390e4 admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:24:14.368404 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 04:24:14.368404 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: warnings.warn(msg) May 09 04:24:14.369594 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-eb629361-0c2e-4562-a923-27e2a75390e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:24:14.370041 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-eb629361-0c2e-4562-a923-27e2a75390e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:24:14.370826 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-eb629361-0c2e-4562-a923-27e2a75390e4 admin admin] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:24:14.371254 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-eb629361-0c2e-4562-a923-27e2a75390e4 admin admin] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:24:14.390450 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-eb629361-0c2e-4562-a923-27e2a75390e4 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074907 May 09 04:24:14.390934 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 9 04:24:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:24:25.714592 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-4df2412c-f7c9-41cc-b490-d069f3156339 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:24:25.715585 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-4df2412c-f7c9-41cc-b490-d069f3156339 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 09 04:24:25.716000 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 04:24:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:24:25.906450 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-e05b5aca-cf59-4aa3-b090-9a3111f169cc admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:24:25.907668 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 04:24:25.907668 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: warnings.warn(msg) May 09 04:24:25.908913 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-e05b5aca-cf59-4aa3-b090-9a3111f169cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:24:25.909501 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-e05b5aca-cf59-4aa3-b090-9a3111f169cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:24:25.910295 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-e05b5aca-cf59-4aa3-b090-9a3111f169cc admin admin] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:24:25.910726 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-e05b5aca-cf59-4aa3-b090-9a3111f169cc admin admin] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:24:25.934840 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-e05b5aca-cf59-4aa3-b090-9a3111f169cc admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080663 May 09 04:24:25.935317 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 9 04:24:25 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:24:26.835160 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: DEBUG nova.api.openstack.wsgi [None req-4df2412c-f7c9-41cc-b490-d069f3156339 admin admin] Calling method '>' {{(pid=102483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:24:26.836223 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: INFO nova.api.openstack.requestlog [None req-4df2412c-f7c9-41cc-b490-d069f3156339 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001667 May 09 04:24:26.836645 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: [pid: 102483|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Mon May 9 04:24:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:24:27.023886 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG nova.api.openstack.wsgi [None req-b79ddeff-0764-4f3d-b854-18e4cef7369a admin admin] Calling method '>' {{(pid=102484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:24:27.025166 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 04:24:27.025166 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: warnings.warn(msg) May 09 04:24:27.026364 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-b79ddeff-0764-4f3d-b854-18e4cef7369a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:24:27.026803 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-b79ddeff-0764-4f3d-b854-18e4cef7369a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:24:27.027616 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-b79ddeff-0764-4f3d-b854-18e4cef7369a admin admin] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:24:27.028113 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: DEBUG oslo_concurrency.lockutils [None req-b79ddeff-0764-4f3d-b854-18e4cef7369a admin admin] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:24:27.050863 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: INFO nova.api.openstack.requestlog [None req-b79ddeff-0764-4f3d-b854-18e4cef7369a admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077849 May 09 04:24:27.051409 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: [pid: 102484|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Mon May 9 04:24:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:25:24.392034 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: Mon May 9 04:25:24 2022 - graceful shutdown triggered... May 09 04:25:24.392561 dv-cinder-838009-3-iscsi devstack@n-api.service[102483]: Gracefully killing worker 1 (pid: 102483)... May 09 04:25:24.392944 dv-cinder-838009-3-iscsi devstack@n-api.service[102484]: Gracefully killing worker 2 (pid: 102484)... May 09 04:25:24.396211 dv-cinder-838009-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 09 04:25:25.393163 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: worker 1 buried after 1 seconds May 09 04:25:25.393626 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: worker 2 buried after 1 seconds May 09 04:25:25.393626 dv-cinder-838009-3-iscsi devstack@n-api.service[102482]: goodbye to uWSGI. May 09 04:25:25.394875 dv-cinder-838009-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 09 04:25:25.395431 dv-cinder-838009-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 09 04:25:25.398807 dv-cinder-838009-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 09 04:25:25.419217 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 09 04:25:25.444393 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 04:25:25 2022] *** May 09 04:25:25.444393 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 04:25:25.444393 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 04:25:25.444393 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: nodename: dv-cinder-838009-3-iscsi May 09 04:25:25.444393 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: machine: x86_64 May 09 04:25:25.444393 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: clock source: unix May 09 04:25:25.444393 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: pcre jit disabled May 09 04:25:25.444393 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: detected number of CPU cores: 4 May 09 04:25:25.444393 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: current working directory: / May 09 04:25:25.444393 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: detected binary path: /usr/bin/uwsgi-core May 09 04:25:25.444393 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: your processes number limit is 47680 May 09 04:25:25.444393 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: your memory page size is 4096 bytes May 09 04:25:25.445406 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: detected max file descriptor number: 2048 May 09 04:25:25.445406 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: lock engine: pthread robust mutexes May 09 04:25:25.445406 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: thunder lock: enabled May 09 04:25:25.445406 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 09 04:25:25.445406 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 04:25:25.491040 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: Python main interpreter initialized at 0x55b71d8849c0 May 09 04:25:25.491040 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: python threads support enabled May 09 04:25:25.492031 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: your server socket listen backlog is limited to 100 connections May 09 04:25:25.492031 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: your mercy for graceful operations on workers is 90 seconds May 09 04:25:25.492031 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: mapped 403077 bytes (393 KB) for 2 cores May 09 04:25:25.492305 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: *** Operational MODE: preforking *** May 09 04:25:25.492384 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: *** uWSGI is running in multiple interpreter mode *** May 09 04:25:25.492384 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: spawned uWSGI master process (pid: 117022) May 09 04:25:25.492603 dv-cinder-838009-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 09 04:25:25.493211 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: spawned uWSGI worker 1 (pid: 117032, cores: 1) May 09 04:25:25.493570 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: spawned uWSGI worker 2 (pid: 117033, cores: 1) May 09 04:25:25.493725 dv-cinder-838009-3-iscsi devstack@n-api.service[117022]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 04:25:26.705668 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 04:25:26.708270 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 04:25:27.523275 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 04:25:27.523275 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: from cryptography.utils import int_from_bytes May 09 04:25:27.523719 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 04:25:27.523719 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: from cryptography.utils import int_from_bytes May 09 04:25:27.524048 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 04:25:27.524048 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: from cryptography.utils import int_from_bytes May 09 04:25:27.524377 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 04:25:27.524377 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: from cryptography.utils import int_from_bytes May 09 04:25:29.998232 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 04:25:29.998777 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 04:25:29.999021 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 04:25:29.999395 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 04:25:29.999657 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 04:25:30.000075 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.000407 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.000732 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.001057 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.001393 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.001710 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.002043 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.002367 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.002698 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.002966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.003287 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.003618 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-838009-3-iscsi {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.003972 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.004287 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.004611 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.004934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.005247 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.005577 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.005891 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.006395 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.007501 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.007824 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.008159 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.008501 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.008818 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.009135 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.009298 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 04:25:30.009701 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.009800 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 04:25:30.009897 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.010068 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 04:25:30.010162 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.010380 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.010543 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 04:25:30.010674 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 04:25:30.010775 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-838009-3-iscsi {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.011060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.011163 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.011387 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.011483 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.011708 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.011802 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.012076 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.012247 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.012409 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.012500 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.012700 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.012836 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.013041 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.013177 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.013344 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.013466 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.013679 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.013843 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.013991 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.014136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.014274 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.014411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.014549 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-838009-3-iscsi {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.014704 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.014869 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.015019 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.015160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.015298 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.015454 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.015604 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.015760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.015942 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.016083 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.016221 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.016401 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.016506 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.016712 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.016813 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.016996 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.017212 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.017332 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.017530 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.017640 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.017840 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.017996 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.018152 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.018253 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.018483 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.018576 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.018740 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.018845 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.019065 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.019173 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.019390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.019482 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.019697 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.019792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.020040 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.020153 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.020350 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.020441 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.020657 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.020755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-838009-3-iscsi {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.020967 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.021076 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.021278 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.021377 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.021588 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.021689 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.021897 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.022050 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.022281 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.023148 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.023301 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.023539 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.023637 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.023773 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.023929 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.024036 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.024261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.024421 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.024502 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.024756 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.024896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.025020 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.025167 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.025338 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.025539 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.025653 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.025871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.025971 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.026208 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.026350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.026521 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.026624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.026834 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.026925 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.027147 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.027241 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.027453 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.027560 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.027761 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.027915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.028056 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.028189 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.028360 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.028465 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.028667 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.028766 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.028976 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.029077 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.029287 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.029397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.029525 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.029627 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.029781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.029907 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.030100 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.030217 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.030421 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.030524 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.030734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.030835 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.031045 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.031137 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.031353 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.031466 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.031661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.031762 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.032000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.032197 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.032309 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.032509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.032615 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.032822 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.032922 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.033140 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.033288 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.033451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.033565 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.033761 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.033857 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.034084 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.034192 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.034411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.034515 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.034722 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.034823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.035034 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.035139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.035343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.035447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.035653 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.035787 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.036003 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.036130 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.036316 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.036526 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.036637 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.036872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.036984 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.037174 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.037275 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.037483 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.037583 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.038442 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.038688 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.038815 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.038935 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.039110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.039206 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.039293 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.039431 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.039522 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.039678 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.039785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.040017 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.040127 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.040341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.040434 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.040654 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.040760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.040965 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.041057 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.041274 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.041373 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.041584 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.041728 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.041886 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.041985 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.042194 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.042291 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.042497 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.042595 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.042803 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.042893 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.043109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.043209 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.043412 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.043513 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.043718 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.043809 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.044048 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.044154 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.044355 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.044493 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.044668 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.044768 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.044994 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.045094 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.045312 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.045399 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.045617 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.045756 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.045925 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.046061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.046229 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.046348 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.046534 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.046637 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.046854 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.046948 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.047159 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.047258 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.047464 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.047556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.047781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.047880 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.048112 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.048205 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.048419 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.048557 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.048735 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.048836 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.049042 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.049148 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.049347 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.049439 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.049665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.049760 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.049967 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.050068 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.050272 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.050365 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.050588 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.050690 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.050893 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.050994 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.051198 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.051302 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.051502 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.051601 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.051806 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.051926 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.052131 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.052225 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.052436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.052527 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.052738 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.052841 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.053046 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.053159 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.053347 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.053543 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.053727 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.054011 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.054140 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.054347 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.054450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.054652 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.054753 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.054958 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.055065 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.055277 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 04:25:30.055369 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.055601 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.055700 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.055950 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.056056 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.056277 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.056378 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.056599 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.056691 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.056915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.057015 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.057234 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.057329 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.057553 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.057660 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.057864 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.057961 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.058176 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.058266 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.058500 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.058611 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.058811 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.058906 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.059124 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.059223 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.059434 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.059540 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.059750 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.059845 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.060094 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.060187 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.060406 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.060520 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.060724 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.060825 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.061166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.061262 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.061346 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.061440 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.061625 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.061719 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.061940 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.062034 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.062248 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.062349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.062573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.062666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.062889 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.062983 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.063198 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.063298 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.063535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.063627 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.063847 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.064023 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.064198 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.064302 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.064522 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.064613 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.064836 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.064929 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.065150 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.065291 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.065491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.065807 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.066111 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.066215 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.066437 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.066536 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.066752 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.066843 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.067059 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.067164 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.067380 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.067471 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.067687 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.067785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.068021 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.068137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.068336 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.068428 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.068647 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.068745 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.068956 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.069604 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.069784 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.069900 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.070197 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.070337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.070520 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.070612 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.070835 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.070934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.071153 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.071247 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.071466 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.071615 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.071780 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.071881 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.072117 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.072226 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.072426 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.072528 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.072734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.072863 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.073045 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.073147 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.073355 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.073449 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.073658 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.073759 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.073964 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.074067 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.074272 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.074373 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.074585 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.074677 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.074897 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.074999 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.075206 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.075299 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.075514 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.075613 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.075818 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.075938 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.076150 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.076253 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.076455 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.076554 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.076766 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.076867 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.077076 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.077168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.077379 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.077480 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.077681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.077781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.077988 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.078080 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.078290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.078392 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.078611 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.078712 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.078916 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.079061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.079223 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.079315 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.079536 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.079636 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.079847 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.079986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.080180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.080280 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.080492 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.080588 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.080803 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.080895 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.081126 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.081232 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.081436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.081529 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.081749 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.081840 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.082070 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.082171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.082386 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.082486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.082691 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.082782 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.083010 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.083114 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.083331 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.083430 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.083644 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.083734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.083965 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.084077 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.084277 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.084415 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.084581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.084731 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.085493 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.085800 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.085887 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.086113 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.086259 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.086447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.086581 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.086753 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.086883 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.087055 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.087159 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.087360 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.087467 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.087665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.087767 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.088028 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.088125 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.088341 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.088444 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.088643 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.088737 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.088945 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.089039 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.089249 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.089354 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.089572 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.089662 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.089883 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.089974 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.090210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.090301 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.090524 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.090660 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.090847 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.090947 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.091157 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.091251 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.091470 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.091560 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.091788 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.091880 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.092127 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.092223 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.092440 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.092532 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.092751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.092842 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.093066 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.093158 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.093378 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.093468 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.093686 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.093792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.093999 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.094139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.094308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.094402 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.094615 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.094722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.094923 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.095015 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.095240 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.095332 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.095545 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.095723 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.095862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.096076 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.096196 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.096298 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.096514 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.096617 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.096828 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.096928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.097136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.097230 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.097442 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.097580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.097755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.097848 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.098082 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.098212 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.098396 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.098539 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.098709 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.099007 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.099104 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.099324 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.099430 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.099635 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.099737 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.099966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.100061 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.100297 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.100412 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.100627 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.100872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.100955 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.101193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.101285 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.101517 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.101611 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.101825 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.101955 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.102140 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.102243 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.102456 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.102547 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.102778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.102878 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.103090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.103241 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.103401 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.103503 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.103717 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.103808 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.104048 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.104155 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.104364 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.104465 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.104672 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.104772 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.104978 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.105082 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.105282 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.105382 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.105593 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.105685 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.105903 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.106002 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.106210 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.106309 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.106521 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.106619 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.106825 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.106917 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.107140 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.107242 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.107451 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.107543 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.107755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.107844 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.108082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.108186 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.108393 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.108492 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.108711 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.108803 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.109020 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.109295 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.109394 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.109633 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.109733 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.109940 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.110040 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.110247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.110391 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.110570 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.110672 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.110878 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.110976 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.111183 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.111312 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.111487 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.111580 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.111789 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.111907 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.112156 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.112268 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.112469 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.112577 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.112777 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.112879 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.113085 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.113176 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.113403 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.113516 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.113712 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.113819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.114021 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.114121 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.114329 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.114421 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.114638 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.114776 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.114948 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.115075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.115256 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.115390 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.115566 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.115688 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.115875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.116081 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.116224 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.116347 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.116537 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.116706 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.116844 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.116945 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.117154 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.117282 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.117460 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.117552 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.117770 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.117870 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.118073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.118172 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.118377 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.118476 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.118679 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.118770 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.118993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.119136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.119316 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.119565 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.119665 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.119927 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.120025 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.120234 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.120328 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.120555 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.120662 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.120873 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.120975 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.121189 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.121284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.121519 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.121655 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.121824 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.121926 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.122130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.122222 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.122443 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.122550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.122754 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.122846 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.123061 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.123151 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.123368 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.123474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.123677 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.123778 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.124014 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.124124 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.124328 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.124418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.124633 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.124727 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.124945 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.125044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.125249 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.125350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.125553 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.125647 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.125857 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.125951 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.126161 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.126260 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.126465 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.126566 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.126771 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.126871 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.127078 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.127181 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.127381 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.127480 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.127690 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.127791 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.128018 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.128116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.128322 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.128425 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.128625 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.128732 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.128927 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.129028 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.129233 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.129332 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.129544 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.129652 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.129857 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.129954 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.130165 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.130265 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.130490 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.130597 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.130802 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.130903 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.131103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.131195 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.131408 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.132074 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.132280 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.132392 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.132591 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.132740 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.132897 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.133049 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.133197 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.133367 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.133523 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.133678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.133846 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.133984 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.134154 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.134294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.134466 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.134604 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.134773 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.134897 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.135080 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.135205 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.135388 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.135493 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.135698 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.135798 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.136034 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.136144 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.136343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.136450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.136649 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.136741 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.136956 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.137047 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.137267 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.137373 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.137581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.137675 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.137890 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.137982 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.138193 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.138302 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.138512 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.138639 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.138801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.138930 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.139117 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.139222 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.139420 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.139513 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.139724 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.139818 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.140053 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.140149 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.140365 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.140504 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.140675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.140768 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.140981 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.141074 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.141304 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.141398 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.141615 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.141708 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.141920 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.142020 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.142223 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.142321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.142535 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.142641 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.142839 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.142939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.143142 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.143240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.143447 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.143555 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.143766 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.143857 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.144103 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.144197 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.144407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.144513 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.144719 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.144827 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.145024 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.145116 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.145326 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.145434 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.145631 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.145725 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.145940 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.146042 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.146246 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.146349 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.146551 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.146652 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.146855 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.146955 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.147177 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.147794 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.148034 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.148157 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.148361 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.148596 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.148709 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.148920 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.149013 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.149240 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.149340 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.149540 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.149643 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.149854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.149945 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.150169 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.150271 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.150485 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.150614 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.150796 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.150898 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.151122 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.151222 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.151434 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.151527 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.151742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.151832 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.152079 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.152173 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.152386 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.152487 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.152689 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.152789 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.152998 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.153090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.153312 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.153433 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.153626 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.153748 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.153932 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.154062 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.154235 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.154371 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.154556 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.154683 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.154866 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.154995 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.155175 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.155316 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.155496 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.155632 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.155819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.155985 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.156167 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.156409 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.156501 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.156726 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.156819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.157038 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.157176 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.157351 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.157453 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.157658 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.157748 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.157963 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.158055 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.158273 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.158373 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.158584 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.158724 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.158894 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.158987 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.159201 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.159301 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.159506 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.159613 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.159809 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.159955 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.160143 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.160249 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.160453 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.160560 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.160758 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.160859 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.161083 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.161184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.161393 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.161500 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.161698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.162106 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.162220 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.162309 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.162478 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.162567 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.162660 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.162827 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.162924 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.163329 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.163420 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.163695 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.163813 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.164034 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.164141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.164358 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.164465 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.164675 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.164776 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.165004 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.165097 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.165334 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.165441 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.165644 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.165743 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.165948 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.166041 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.166260 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.166366 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.166590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.166685 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.166917 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.167019 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.167235 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.167335 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.167545 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.167635 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.167851 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.167990 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.168182 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.168304 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.168506 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.168646 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.168814 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.168917 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.169185 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.169280 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.169496 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.169590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.169821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.169923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.170127 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.170220 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.170431 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.170534 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.170738 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.170878 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.171064 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.171157 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.171373 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.171481 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.171686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.171846 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.172024 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.172181 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.172338 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.172494 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.172646 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.172817 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.172953 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.173141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.173279 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.173471 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.173573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.173779 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.173879 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.174094 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.174187 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.174406 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.174501 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.174732 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.174825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.175057 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.175163 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.175371 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.175472 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.175686 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.175786 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.176022 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.176134 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.176335 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.176427 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.176642 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.176736 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.176957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.177058 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.177278 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.177423 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.177602 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.177696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.177936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.178048 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.178268 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.178369 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.179113 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.179244 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.179453 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.179630 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.179778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.179872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.180123 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.180229 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.180443 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.180542 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.180750 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.180843 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.181055 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.181151 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.181360 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.181461 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.181671 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.181762 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.181975 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.182062 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.182283 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.182390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.182589 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.182727 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.182900 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.183009 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.183209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.183309 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.183515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.183615 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.183821 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.183976 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.184172 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.184301 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.184482 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.184578 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.184803 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.184978 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.185112 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.185207 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.185416 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.185509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.185719 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.185822 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.186024 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.186132 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.186325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.186417 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.186629 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.186724 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.186931 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.187025 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.187270 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.187363 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.187576 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.187673 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.187911 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.188008 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.188235 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.188326 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.188559 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.188652 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.188872 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.188963 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.189189 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.189282 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.189505 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.189606 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.189816 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.189907 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.190129 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.190231 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.190447 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.190548 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.190749 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.190886 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.191053 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.191160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.191362 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.191463 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.191665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.191758 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.191998 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.192144 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.192305 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.192528 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.192622 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.192861 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.192956 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.193180 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.193274 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.193479 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.193571 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.193803 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.193911 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.194668 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.194774 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.194997 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.195160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.195315 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.195577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.195672 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.195887 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.196022 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.196214 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.196315 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.196520 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.196614 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.196863 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.196957 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.197169 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.197276 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.197501 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.197639 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.197815 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.197909 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.198137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.198244 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.198451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.198545 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.198757 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.198850 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.199079 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.199181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.199442 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.199551 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.199703 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.199805 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.200039 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.200136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.200354 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.200459 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.200667 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.200803 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.200979 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.201079 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.201289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.201383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.201596 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.201687 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.201909 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.202010 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.202220 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.202355 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.202530 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.202622 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.202846 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.203051 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.203147 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.203379 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.203481 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.203691 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.203793 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.204031 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.204140 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.204346 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.204440 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.204658 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.204752 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.204969 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.205062 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.205280 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.205539 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.205646 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.205857 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.205959 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.206180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.206271 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.206504 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.206607 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.206829 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.206928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.207148 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.207250 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.207468 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.207570 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.207782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.207876 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.208122 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.208216 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.208430 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.208532 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.208740 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.208839 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.209050 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.209151 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.209359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.209453 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.209747 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.210115 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.210335 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.210432 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.210642 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.210732 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.210966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.211067 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.211280 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.211381 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.211618 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.211819 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.211974 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.212196 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.212345 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.212515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.212612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.212842 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.212943 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.213149 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.213250 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.213463 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.213556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.213769 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.213861 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.214094 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.214197 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.214403 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.214495 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.214713 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.214803 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.215024 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.215120 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.215335 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.215437 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.215644 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.215852 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.215987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.216191 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.216284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.216525 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.216619 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.216852 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.216955 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.217174 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.217265 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.217481 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.217582 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.217797 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.217927 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.218108 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.218228 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.218416 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.218520 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.218723 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.218815 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.219033 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.219125 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.219337 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.219464 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.219639 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.219732 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.219966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.220062 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.220274 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.220380 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.220583 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.220719 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.220886 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.221014 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.221197 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.221288 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.221502 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.221731 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.221826 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.222077 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.222170 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.222399 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.222491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.222762 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.222861 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.223086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.223185 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.223394 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.223487 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.223695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.223794 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.224019 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.224341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.224647 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.224751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.224968 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.225068 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.225299 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.225404 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.225627 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.225759 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.226020 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.226111 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.226344 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.226608 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.226692 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.226952 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.227052 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.227263 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.227355 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.227575 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.227697 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.227909 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.228034 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.228258 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.228572 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.228678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.228885 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.228986 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.229214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.229307 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.229529 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.229633 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.229844 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.229937 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.230155 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.230246 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.230463 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.230557 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.230770 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.230871 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.231076 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.231222 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.231383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.231513 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.231693 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.231785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.232020 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.232128 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.232334 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.232427 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.232638 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.232742 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.232949 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.233051 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.233252 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.233344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.233562 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.233662 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.233904 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.234005 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.234226 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.234319 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.234533 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.234624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.234838 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.234941 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.235151 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.235243 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.235461 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.235554 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.235779 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.235885 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.236118 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.236212 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.236427 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.236518 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.236758 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.236859 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.237077 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.237169 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.237385 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.237611 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.237805 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.237947 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.238122 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.238271 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.238446 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.238604 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.238771 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.238935 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.239086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.239246 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.239410 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.239740 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.247935 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.248116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.248229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.248397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.248528 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.248628 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.248707 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.248790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.248864 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.248961 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.249051 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.249159 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.249256 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.249345 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.249438 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.249529 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.249613 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.249688 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.249773 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.249847 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.249920 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.250006 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.250115 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.250203 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.250279 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.250351 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.250422 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.250422 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.250573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.250676 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.250759 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.250840 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.250914 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.250985 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.251135 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.251212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.251285 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.251356 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.251426 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.251507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.251588 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.251668 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.251741 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.251813 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.251911 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.252028 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.252028 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.252181 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.252254 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.252334 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.252406 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.252487 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.252560 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.252631 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.252702 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.252772 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.252853 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.252927 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.252999 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.253070 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.253149 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.253149 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.253308 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.253402 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.253494 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.253569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.253648 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.253721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.253806 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.253887 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.253966 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.254039 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.254135 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.254226 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.254309 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.254383 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.254462 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.254538 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.254686 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.254801 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.254906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.255046 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.255138 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.255220 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.255303 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.255386 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.255461 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.255532 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.255605 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.255676 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.255754 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.255861 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.256080 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.256161 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.256241 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.256314 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.256397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.256471 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.256585 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.257170 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.257449 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.257902 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.258010 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.258101 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.258196 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.258284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.258370 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.258370 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.258523 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.258598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.258685 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.258758 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.258842 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.258928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.259027 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.259229 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.259368 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.259560 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.259668 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.259977 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.260075 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.260245 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.260356 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.260500 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.260603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.260811 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.260919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.261124 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.261216 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.261441 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.261540 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.261752 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.261862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.262063 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.262166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.262372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.262490 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.262684 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.262783 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.263090 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.263272 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.263408 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.263623 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.263755 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.263988 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.264116 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.264319 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.264444 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.264652 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.264771 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.264968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.265075 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.265272 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 04:25:30.265398 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.265603 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.265932 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.266259 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.266582 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.266898 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.267236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.267551 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.267869 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.268221 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.268541 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.268865 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.269182 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.269516 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.269843 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.270163 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.270493 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.270816 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.271140 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.271463 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.271779 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.272136 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.272511 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.272989 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.273089 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.273408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.273725 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.274045 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.274367 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.274704 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.275037 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.275369 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.275704 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.276078 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.276398 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.276748 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.277084 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.277406 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.277725 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.278039 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 04:25:30.278288 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 04:25:30.288861 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_db.sqlalchemy.engines [None req-31f12506-4412-4f1b-8c2f-af07079586a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:25:30.301291 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_db.sqlalchemy.engines [None req-df601080-00d9-422c-b565-bc1a43c4f779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:25:30.354959 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.context [None req-31f12506-4412-4f1b-8c2f-af07079586a9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1633d3c-e28c-4cff-8311-7e3f4477d0ce(cell1) {{(pid=117032) load_cells /opt/stack/nova/nova/context.py:464}} May 09 04:25:30.359342 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-31f12506-4412-4f1b-8c2f-af07079586a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:25:30.360938 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-31f12506-4412-4f1b-8c2f-af07079586a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:25:30.361749 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-31f12506-4412-4f1b-8c2f-af07079586a9 None None] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:25:30.363665 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-31f12506-4412-4f1b-8c2f-af07079586a9 None None] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:25:30.367416 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.context [None req-df601080-00d9-422c-b565-bc1a43c4f779 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1633d3c-e28c-4cff-8311-7e3f4477d0ce(cell1) {{(pid=117033) load_cells /opt/stack/nova/nova/context.py:464}} May 09 04:25:30.371873 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df601080-00d9-422c-b565-bc1a43c4f779 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:25:30.373489 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df601080-00d9-422c-b565-bc1a43c4f779 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:25:30.374321 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df601080-00d9-422c-b565-bc1a43c4f779 None None] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:25:30.375757 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_db.sqlalchemy.engines [None req-31f12506-4412-4f1b-8c2f-af07079586a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:25:30.377179 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df601080-00d9-422c-b565-bc1a43c4f779 None None] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:25:30.380604 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_db.sqlalchemy.engines [None req-31f12506-4412-4f1b-8c2f-af07079586a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:25:30.389424 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_db.sqlalchemy.engines [None req-df601080-00d9-422c-b565-bc1a43c4f779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:25:30.390772 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_db.sqlalchemy.engines [None req-df601080-00d9-422c-b565-bc1a43c4f779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:25:30.541955 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_db.sqlalchemy.engines [None req-31f12506-4412-4f1b-8c2f-af07079586a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:25:30.557532 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_db.sqlalchemy.engines [None req-df601080-00d9-422c-b565-bc1a43c4f779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 04:25:30.876371 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: WARNING keystonemiddleware.auth_token [None req-31f12506-4412-4f1b-8c2f-af07079586a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 04:25:30.884220 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: WARNING keystonemiddleware.auth_token [None req-31f12506-4412-4f1b-8c2f-af07079586a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 04:25:30.890914 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: WARNING keystonemiddleware.auth_token [None req-df601080-00d9-422c-b565-bc1a43c4f779 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 04:25:30.899228 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: WARNING keystonemiddleware.auth_token [None req-df601080-00d9-422c-b565-bc1a43c4f779 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 04:25:31.242452 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: WARNING keystonemiddleware.auth_token [None req-31f12506-4412-4f1b-8c2f-af07079586a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 04:25:31.247403 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: WARNING keystonemiddleware.auth_token [None req-df601080-00d9-422c-b565-bc1a43c4f779 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 04:25:31.248801 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: WARNING keystonemiddleware.auth_token [None req-31f12506-4412-4f1b-8c2f-af07079586a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 04:25:31.253604 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: WARNING keystonemiddleware.auth_token [None req-df601080-00d9-422c-b565-bc1a43c4f779 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 04:25:31.254172 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b71d8849c0 pid: 117032 (default app) May 09 04:25:31.259071 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b71d8849c0 pid: 117033 (default app) May 09 04:26:14.422379 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7697da5a-a9e2-46c3-b097-b462d16f8969 tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] Action: 'create', calling method: .version_select at 0x7fbfd6575280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1832961709", "metadata": {"Type": "work"}}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:26:14.663124 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8f2802c4-5d2f-4c9a-8375-dca486d019a4 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Action: 'create', calling method: .version_select at 0x7fbfd6574280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1428343301"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:26:16.696997 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7697da5a-a9e2-46c3-b097-b462d16f8969 tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.019573 May 09 04:26:16.697964 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1155 bytes} [Mon May 9 04:26:12 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4022 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 09 04:26:16.897986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-913890938", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "networks": [{"uuid": "38a931bd-bcdb-4a4e-93b0-9762abc0163c"}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:26:16.975528 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8f2802c4-5d2f-4c9a-8375-dca486d019a4 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.984305 May 09 04:26:16.976497 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 1/2] 10.222.0.44 () {60 vars in 1154 bytes} [Mon May 9 04:26:12 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3989 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 09 04:26:16.983266 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-39d290c1-54cb-4334-a792-65d2c0c57a80 tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] Calling method '.version_select at 0x7fbfd63cc280>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:17.138713 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] validate_networks() for [('38a931bd-bcdb-4a4e-93b0-9762abc0163c', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:26:17.165382 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-39d290c1-54cb-4334-a792-65d2c0c57a80 tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b990629c-2113-477f-86e8-808ba206287f" status: 200 len: 353 microversion: 2.1 time: 0.185884 May 09 04:26:17.166429 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 04:26:16 2022] GET /compute/v2.1/os-volumes/b990629c-2113-477f-86e8-808ba206287f => generated 353 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:26:17.181489 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6cf747f8-ebf0-4ff8-9664-4bac98b6d3c9 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd63cc430>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:17.314120 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6cf747f8-ebf0-4ff8-9664-4bac98b6d3c9 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e" status: 200 len: 345 microversion: 2.1 time: 0.144130 May 09 04:26:17.314907 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 3/4] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 04:26:17 2022] GET /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e => generated 345 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:26:18.179169 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a0aa35e1-930e-4624-af75-18365dae3394 tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] Calling method '.version_select at 0x7fbfd63cca60>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:18.292085 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a0aa35e1-930e-4624-af75-18365dae3394 tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b990629c-2113-477f-86e8-808ba206287f" status: 200 len: 354 microversion: 2.1 time: 0.116927 May 09 04:26:18.292913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 4/5] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 04:26:18 2022] GET /compute/v2.1/os-volumes/b990629c-2113-477f-86e8-808ba206287f => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:26:18.305970 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-cca467a0-968b-4817-b735-7d5a86cf7bdd tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] Calling method '.version_select at 0x7fbfd63d6160>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:18.527159 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-cca467a0-968b-4817-b735-7d5a86cf7bdd tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b990629c-2113-477f-86e8-808ba206287f" status: 200 len: 354 microversion: 2.1 time: 0.225234 May 09 04:26:18.528385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 5/6] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 04:26:18 2022] GET /compute/v2.1/os-volumes/b990629c-2113-477f-86e8-808ba206287f => generated 354 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:26:18.539443 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-97d7abb8-4d95-47c7-8579-e976c49a9f22 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd63ccb80>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:18.672966 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-97d7abb8-4d95-47c7-8579-e976c49a9f22 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e" status: 200 len: 346 microversion: 2.1 time: 0.143267 May 09 04:26:18.674108 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 6/7] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 04:26:18 2022] GET /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e => generated 346 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:26:18.681346 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b3f766a7-5bf1-459c-9995-b1cfd28fe0b0 tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] Calling method '.version_select at 0x7fbfd63cc1f0>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:18.795621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b3f766a7-5bf1-459c-9995-b1cfd28fe0b0 tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/b990629c-2113-477f-86e8-808ba206287f" status: 202 len: 0 microversion: 2.1 time: 0.120225 May 09 04:26:18.796453 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 7/8] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 04:26:18 2022] DELETE /compute/v2.1/os-volumes/b990629c-2113-477f-86e8-808ba206287f => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:26:18.805744 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ada4993b-46ef-41f2-8b52-6dd6ea459aa7 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Action: 'create', calling method: .version_select at 0x7fbfd63d6430>, body: {"snapshot": {"volume_id": "58c39049-154e-4773-a145-64bb9675049e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-650733220"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:26:19.415932 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ada4993b-46ef-41f2-8b52-6dd6ea459aa7 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.617978 May 09 04:26:19.416648 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 8/9] 10.222.0.44 () {60 vars in 1161 bytes} [Mon May 9 04:26:18 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:26:19.421537 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ec3334dc-4e14-4d8e-b9be-5da8df7a5866 tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] Calling method '.version_select at 0x7fbfd63cc160>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-ec3334dc-4e14-4d8e-b9be-5da8df7a5866 tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] HTTP exception thrown: Volume b990629c-2113-477f-86e8-808ba206287f could not be found. May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ec3334dc-4e14-4d8e-b9be-5da8df7a5866 tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] Request method failure captured: May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/os-volumes/b990629c-2113-477f-86e8-808ba206287f HTTP/1.1 May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJfkhY3kCsq9oNpfixavGJ-IfCuKHP5BBDA2Yqvq0585Oix6Wg1HJ8xOi6gAfp1lYiBDW0C7QZXmbm9N3ezq0UBzd2dN21nhRQrBmQfYxYiFjUq9BlQYBtADFdue45yTAlyJc9SHjhlNbNMOTk9v018WogJHUCid7c-2D1zCC_G895A May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: d8b020b16f9c43cb9e04a786011069c4 May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-VolumesGetTestJSON-1134898797 May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:26:19.511447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:26:19.522180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d8b020b16f9c43cb9e04a786011069c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d8b020b16f9c43cb9e04a786011069c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d8b020b16f9c43cb9e04a786011069c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d8b020b16f9c43cb9e04a786011069c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:26:19.522180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-VolumesGetTestJSON-1134898797 May 09 04:26:19.522180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: d8b020b16f9c43cb9e04a786011069c4 May 09 04:26:19.522180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-VolumesGetTestJSON-1134898797 May 09 04:26:19.522180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-VolumesGetTestJSON-1134898797-project May 09 04:26:19.522180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:26:19.522180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:26:19.522180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 8381a286bb624131b5a610de86488e84 May 09 04:26:19.522180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-VolumesGetTestJSON-1134898797-project May 09 04:26:19.522180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: May 09 04:26:19.522180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Volume b990629c-2113-477f-86e8-808ba206287f could not be found. May 09 04:26:19.522180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': 'b990629c-2113-477f-86e8-808ba206287f'} May 09 04:26:19.522180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b990629c-2113-477f-86e8-808ba206287f could not be found. (HTTP 404) (Request-ID: req-690f2335-d817-495f-a7c3-284efcf0bbd2) May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:19.525279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 04:26:19.527372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b990629c-2113-477f-86e8-808ba206287f could not be found. May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 04:26:19.529385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:26:19.531399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b990629c-2113-477f-86e8-808ba206287f could not be found. May 09 04:26:19.531399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:19.531399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:19.531399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:19.531399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:19.531399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:26:19.531399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:26:19.531399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:26:19.531399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:26:19.531399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b990629c-2113-477f-86e8-808ba206287f could not be found. May 09 04:26:19.531399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:19.531399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ec3334dc-4e14-4d8e-b9be-5da8df7a5866 tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] Returning 404 to user: Volume b990629c-2113-477f-86e8-808ba206287f could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:26:19.531399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ec3334dc-4e14-4d8e-b9be-5da8df7a5866 tempest-VolumesGetTestJSON-1134898797 tempest-VolumesGetTestJSON-1134898797-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b990629c-2113-477f-86e8-808ba206287f" status: 404 len: 109 microversion: 2.1 time: 0.091780 May 09 04:26:19.531399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 9/10] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 04:26:19 2022] GET /compute/v2.1/os-volumes/b990629c-2113-477f-86e8-808ba206287f => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:26:19.554622 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b1771c33-706c-46a7-ba15-03a6e855ee8e tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd6500c10>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:19.619784 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:26:19.620373 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:26:19.620720 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:26:19.623632 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:26:19.627424 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:26:19.673703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:19.674170 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:19.674973 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:19.675401 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:19.719114 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b1771c33-706c-46a7-ba15-03a6e855ee8e tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980" status: 200 len: 286 microversion: 2.1 time: 0.205562 May 09 04:26:19.725044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 10/11] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 04:26:19 2022] GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980 => generated 286 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:26:19.731048 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d763ead7-6076-4039-8ae0-2d17e5d9053b tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd63cc3a0>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:19.768099 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Getting quotas for project 935900d28d414052836bae2238354dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:26:19.788123 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Getting quotas for user 9461afbc4a9545f087184cb5e8465512 and project 935900d28d414052836bae2238354dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:26:19.826156 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:26:19.848528 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:26:19.867694 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d763ead7-6076-4039-8ae0-2d17e5d9053b tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.140656 May 09 04:26:19.869392 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 11/12] 10.222.0.44 () {58 vars in 1139 bytes} [Mon May 9 04:26:19 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:26:19.921962 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5a165efd-d427-47c3-bf2b-d5c2977d0a1b tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd63dc9d0>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:20.002316 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5a165efd-d427-47c3-bf2b-d5c2977d0a1b tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980" status: 200 len: 286 microversion: 2.1 time: 0.126767 May 09 04:26:20.003024 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 12/13] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 04:26:19 2022] GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980 => generated 286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:26:20.177784 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-355f1018-7b63-482c-93c7-51736830c334 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.477951 May 09 04:26:20.184370 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 2/14] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:26:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:26:20.190979 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1993dafd-f1f0-4b7e-b81f-df5a641660d5 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:20.191752 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1993dafd-f1f0-4b7e-b81f-df5a641660d5 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:20.417627 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1993dafd-f1f0-4b7e-b81f-df5a641660d5 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:20.445986 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1993dafd-f1f0-4b7e-b81f-df5a641660d5 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1214 microversion: 2.1 time: 0.259729 May 09 04:26:20.456484 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 13/15] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:20 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1214 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:21.014440 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-54537541-d181-4be8-83f8-ab3a4153a2a5 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd66c7dc0>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:21.066966 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-54537541-d181-4be8-83f8-ab3a4153a2a5 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980" status: 200 len: 286 microversion: 2.1 time: 0.056142 May 09 04:26:21.068275 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 14/16] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 04:26:21 2022] GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:26:21.210528 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a97631be-2d45-4c8d-8102-7442f8dff077 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Action: 'create', calling method: .version_select at 0x7fbfd5add3a0>, body: {"keypair": {"name": "tempest-keypair-872048384"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:26:21.288348 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-a97631be-2d45-4c8d-8102-7442f8dff077 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Getting quotas for project 3c23c235fa1c4944bd7a337357d0c030. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:26:21.303745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-a97631be-2d45-4c8d-8102-7442f8dff077 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Getting quotas for user 85429c28c994443eb30b98ece56c4c9b and project 3c23c235fa1c4944bd7a337357d0c030. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:26:21.464307 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-284586ec-a0ae-449c-b32d-b4962b8d15e4 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:21.465016 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-284586ec-a0ae-449c-b32d-b4962b8d15e4 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:22.064578 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-284586ec-a0ae-449c-b32d-b4962b8d15e4 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:22.077850 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-284586ec-a0ae-449c-b32d-b4962b8d15e4 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1214 microversion: 2.1 time: 0.617742 May 09 04:26:22.082998 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 15/17] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:21 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1214 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:26:22.094849 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-20885f55-6fc2-4d6f-9d92-b2aab58b787c tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd6309f70>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:22.184747 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-20885f55-6fc2-4d6f-9d92-b2aab58b787c tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980" status: 200 len: 286 microversion: 2.1 time: 0.099770 May 09 04:26:22.185327 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 16/18] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 04:26:22 2022] GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980 => generated 286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:26:22.544692 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-a97631be-2d45-4c8d-8102-7442f8dff077 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Getting quotas for project 3c23c235fa1c4944bd7a337357d0c030. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:26:22.557796 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-a97631be-2d45-4c8d-8102-7442f8dff077 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Getting quotas for user 85429c28c994443eb30b98ece56c4c9b and project 3c23c235fa1c4944bd7a337357d0c030. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:26:22.579123 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a97631be-2d45-4c8d-8102-7442f8dff077 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.841492 May 09 04:26:22.580565 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 3/19] 10.222.0.44 () {60 vars in 1157 bytes} [Mon May 9 04:26:20 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:23.098698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-0dcdf8ff-d8ac-4189-be45-ba988428e21a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:23.099429 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-0dcdf8ff-d8ac-4189-be45-ba988428e21a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:23.108228 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0dcdf8ff-d8ac-4189-be45-ba988428e21a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:23.111944 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0dcdf8ff-d8ac-4189-be45-ba988428e21a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:23.115613 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0dcdf8ff-d8ac-4189-be45-ba988428e21a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:23.118583 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0dcdf8ff-d8ac-4189-be45-ba988428e21a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:23.196942 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bb0e8f8f-8bc5-404e-9ddc-8d190bc1ecf4 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd5aea670>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:23.243347 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bb0e8f8f-8bc5-404e-9ddc-8d190bc1ecf4 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980" status: 200 len: 287 microversion: 2.1 time: 0.050999 May 09 04:26:23.250333 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 4/20] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 04:26:23 2022] GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:26:23.259054 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-78e9aa4e-62cc-4814-9029-515d5c62404d tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd5aead30>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:23.396920 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-78e9aa4e-62cc-4814-9029-515d5c62404d tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980" status: 202 len: 0 microversion: 2.1 time: 0.144621 May 09 04:26:23.402203 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 5/21] 10.222.0.44 () {58 vars in 1253 bytes} [Mon May 9 04:26:23 2022] DELETE /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:26:23.408520 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-43742d3e-f700-4152-9cc9-7679c462d01a tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd4a8a430>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:23.458139 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-43742d3e-f700-4152-9cc9-7679c462d01a tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980" status: 200 len: 286 microversion: 2.1 time: 0.054449 May 09 04:26:23.459254 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 6/22] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 04:26:23 2022] GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:26:23.525099 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-0dcdf8ff-d8ac-4189-be45-ba988428e21a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:23.545650 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-0dcdf8ff-d8ac-4189-be45-ba988428e21a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1218 microversion: 2.1 time: 0.452016 May 09 04:26:23.548149 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 17/23] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:23 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1218 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:24.473882 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e7c5c3f2-52f5-49f8-a073-52beb9506a82 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd5aeaee0>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:24.563974 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c5476690-d5fe-4975-bf6d-8b9f88181590 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:24.564561 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c5476690-d5fe-4975-bf6d-8b9f88181590 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:24.570556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e7c5c3f2-52f5-49f8-a073-52beb9506a82 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980" status: 200 len: 286 microversion: 2.1 time: 0.102002 May 09 04:26:24.571454 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 7/24] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 04:26:24 2022] GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980 => generated 286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:26:24.579258 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c5476690-d5fe-4975-bf6d-8b9f88181590 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:24.579647 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c5476690-d5fe-4975-bf6d-8b9f88181590 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:24.589617 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c5476690-d5fe-4975-bf6d-8b9f88181590 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:24.590275 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c5476690-d5fe-4975-bf6d-8b9f88181590 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:24.812854 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c5476690-d5fe-4975-bf6d-8b9f88181590 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:24.820627 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c5476690-d5fe-4975-bf6d-8b9f88181590 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1218 microversion: 2.1 time: 0.261601 May 09 04:26:24.821202 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 18/25] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:24 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1218 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:26:25.582016 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0ddc026f-1908-4f74-b45c-240d448ced34 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd5aea790>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:25.648978 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0ddc026f-1908-4f74-b45c-240d448ced34 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980" status: 200 len: 286 microversion: 2.1 time: 0.070569 May 09 04:26:25.649565 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 8/26] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 04:26:25 2022] GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:26:25.839683 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-844338d0-52e2-43a6-9d33-27d31fa0c114 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:25.841804 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-844338d0-52e2-43a6-9d33-27d31fa0c114 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:25.858417 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-844338d0-52e2-43a6-9d33-27d31fa0c114 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:25.864145 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-844338d0-52e2-43a6-9d33-27d31fa0c114 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:25.869228 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-844338d0-52e2-43a6-9d33-27d31fa0c114 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:25.870144 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-844338d0-52e2-43a6-9d33-27d31fa0c114 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:26.218941 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-844338d0-52e2-43a6-9d33-27d31fa0c114 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:26.231314 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-844338d0-52e2-43a6-9d33-27d31fa0c114 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1210 microversion: 2.1 time: 0.398337 May 09 04:26:26.233017 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 19/27] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:25 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1210 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:26.662645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e0737b28-47dd-479d-8693-02e62eaff822 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd4a8a550>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:26.731323 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-e0737b28-47dd-479d-8693-02e62eaff822 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] HTTP exception thrown: Snapshot 319fad2d-032d-4803-899c-841af595e980 could not be found. May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e0737b28-47dd-479d-8693-02e62eaff822 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Request method failure captured: May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980 HTTP/1.1 May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJfkRF_nCACxFG_G-HbuVEQuVcQLD7D9l1lrxG4NkWsiw7OKOKIZHl_76R7OgMNxxcOpk7b878jxDpck06dLRTUISlB4X1CFZXs1OhV4pVmDkj5VKsRe8xeXpmYaShSqVGdlSFiMGtDQfyrkVuQDrg_sqasPjG-FXWpVLGFI6d9oB3g May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 4b289587284a4aba96b85ffec328efff May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1393918454 May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:26:26.739044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:26:26.740457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4b289587284a4aba96b85ffec328efff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b289587284a4aba96b85ffec328efff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b289587284a4aba96b85ffec328efff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4b289587284a4aba96b85ffec328efff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:26:26.740457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1393918454 May 09 04:26:26.740457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 4b289587284a4aba96b85ffec328efff May 09 04:26:26.740457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1393918454 May 09 04:26:26.740457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-VolumesSnapshotsTestJSON-1393918454-project May 09 04:26:26.740457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:26:26.740457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:26:26.740457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 3fd3e173caa849b98a2e58339001e0b7 May 09 04:26:26.740457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1393918454-project May 09 04:26:26.740457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: May 09 04:26:26.740457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Snapshot 319fad2d-032d-4803-899c-841af595e980 could not be found. May 09 04:26:26.740457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '319fad2d-032d-4803-899c-841af595e980'} May 09 04:26:26.740457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 319fad2d-032d-4803-899c-841af595e980 could not be found. (HTTP 404) (Request-ID: req-542b56f5-5330-4e4d-90d9-d01a3c426559) May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:26:26.741160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 04:26:26.742031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 319fad2d-032d-4803-899c-841af595e980 could not be found. May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 09 04:26:26.742919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:26:26.747183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 319fad2d-032d-4803-899c-841af595e980 could not be found. May 09 04:26:26.747183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:26:26.747183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:26.747183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:26:26.747183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:26.747183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:26:26.747183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:26:26.747183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:26:26.747183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:26:26.747183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 319fad2d-032d-4803-899c-841af595e980 could not be found. May 09 04:26:26.747183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:26:26.749468 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e0737b28-47dd-479d-8693-02e62eaff822 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Returning 404 to user: Snapshot 319fad2d-032d-4803-899c-841af595e980 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:26:26.750737 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e0737b28-47dd-479d-8693-02e62eaff822 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980" status: 404 len: 111 microversion: 2.1 time: 0.093922 May 09 04:26:26.757759 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 9/28] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 04:26:26 2022] GET /compute/v2.1/os-snapshots/319fad2d-032d-4803-899c-841af595e980 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:26:26.780458 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-38947e1f-5e53-4d52-8fa3-f516f1d16da6 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd6302430>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:26.965079 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-38947e1f-5e53-4d52-8fa3-f516f1d16da6 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e" status: 202 len: 0 microversion: 2.1 time: 0.199544 May 09 04:26:26.966978 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 20/29] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 04:26:26 2022] DELETE /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:26:26.976218 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-86874a1b-6c32-4d96-82aa-64783392ef64 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd4a8ac10>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:27.092567 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-86874a1b-6c32-4d96-82aa-64783392ef64 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e" status: 200 len: 345 microversion: 2.1 time: 0.121586 May 09 04:26:27.098506 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 10/30] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 04:26:26 2022] GET /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:26:27.251508 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f944fcfa-0748-412a-bd20-6ed5ed5d404d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:27.252441 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f944fcfa-0748-412a-bd20-6ed5ed5d404d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:27.261486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f944fcfa-0748-412a-bd20-6ed5ed5d404d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:27.262278 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f944fcfa-0748-412a-bd20-6ed5ed5d404d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:27.263209 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f944fcfa-0748-412a-bd20-6ed5ed5d404d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:27.263800 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f944fcfa-0748-412a-bd20-6ed5ed5d404d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:27.403980 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f944fcfa-0748-412a-bd20-6ed5ed5d404d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:27.413098 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f944fcfa-0748-412a-bd20-6ed5ed5d404d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1272 microversion: 2.1 time: 0.166454 May 09 04:26:27.425296 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 21/31] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:27 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:28.106410 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5f549017-04bd-4664-bcff-2a7e90319653 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd6302040>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:28.190507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e1773ab7-eb34-4b35-8ab5-93d1c8b5459d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Action: 'create', calling method: .version_select at 0x7fbfd4a6d280>, body: {"keypair": {"name": "tempest-keypair-475241563"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:26:28.239087 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-e1773ab7-eb34-4b35-8ab5-93d1c8b5459d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Getting quotas for project 5e56ba7f9cc64897a1d95ac15061e9e4. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:26:28.266125 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-e1773ab7-eb34-4b35-8ab5-93d1c8b5459d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Getting quotas for user 4f8f6c77f898475e8acf1c4042c3928b and project 5e56ba7f9cc64897a1d95ac15061e9e4. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:26:28.305464 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-5f549017-04bd-4664-bcff-2a7e90319653 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] HTTP exception thrown: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5f549017-04bd-4664-bcff-2a7e90319653 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Request method failure captured: May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e HTTP/1.1 May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJfkRF_nCACxFG_G-HbuVEQuVcQLD7D9l1lrxG4NkWsiw7OKOKIZHl_76R7OgMNxxcOpk7b878jxDpck06dLRTUISlB4X1CFZXs1OhV4pVmDkj5VKsRe8xeXpmYaShSqVGdlSFiMGtDQfyrkVuQDrg_sqasPjG-FXWpVLGFI6d9oB3g May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 4b289587284a4aba96b85ffec328efff May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1393918454 May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:26:28.307587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:26:28.308676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4b289587284a4aba96b85ffec328efff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b289587284a4aba96b85ffec328efff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b289587284a4aba96b85ffec328efff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4b289587284a4aba96b85ffec328efff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:26:28.308676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1393918454 May 09 04:26:28.308676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 4b289587284a4aba96b85ffec328efff May 09 04:26:28.308676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1393918454 May 09 04:26:28.308676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-VolumesSnapshotsTestJSON-1393918454-project May 09 04:26:28.308676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:26:28.308676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:26:28.308676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 3fd3e173caa849b98a2e58339001e0b7 May 09 04:26:28.308676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1393918454-project May 09 04:26:28.308676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: May 09 04:26:28.308676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:28.308676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': '58c39049-154e-4773-a145-64bb9675049e'} May 09 04:26:28.308676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. (HTTP 404) (Request-ID: req-fb176099-320a-40dc-98d3-5498734c557e) May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:28.309418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 04:26:28.310294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 04:26:28.311781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:26:28.312695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:28.312695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:28.312695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:28.312695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:28.312695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:28.312695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:26:28.312695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:26:28.312695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:26:28.312695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:26:28.312695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:28.312695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:28.312695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5f549017-04bd-4664-bcff-2a7e90319653 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Returning 404 to user: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:26:28.312695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5f549017-04bd-4664-bcff-2a7e90319653 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e" status: 404 len: 109 microversion: 2.1 time: 0.206973 May 09 04:26:28.319511 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 22/32] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 04:26:28 2022] GET /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e => generated 109 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 04:26:28.334245 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-eb7e68b6-e71b-45d2-abe6-b96a8a5ab9ed tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd63d6d30>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:28.611284 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-eb7e68b6-e71b-45d2-abe6-b96a8a5ab9ed tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] HTTP exception thrown: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-eb7e68b6-e71b-45d2-abe6-b96a8a5ab9ed tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Request method failure captured: May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: DELETE /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e HTTP/1.1 May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJfkRF_nCACxFG_G-HbuVEQuVcQLD7D9l1lrxG4NkWsiw7OKOKIZHl_76R7OgMNxxcOpk7b878jxDpck06dLRTUISlB4X1CFZXs1OhV4pVmDkj5VKsRe8xeXpmYaShSqVGdlSFiMGtDQfyrkVuQDrg_sqasPjG-FXWpVLGFI6d9oB3g May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 4b289587284a4aba96b85ffec328efff May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1393918454 May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:26:28.613641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:26:28.614665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4b289587284a4aba96b85ffec328efff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b289587284a4aba96b85ffec328efff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b289587284a4aba96b85ffec328efff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4b289587284a4aba96b85ffec328efff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:26:28.614665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1393918454 May 09 04:26:28.614665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 4b289587284a4aba96b85ffec328efff May 09 04:26:28.614665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1393918454 May 09 04:26:28.614665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-VolumesSnapshotsTestJSON-1393918454-project May 09 04:26:28.614665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:26:28.614665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:26:28.614665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 3fd3e173caa849b98a2e58339001e0b7 May 09 04:26:28.614665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1393918454-project May 09 04:26:28.614665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: May 09 04:26:28.614665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:28.614665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': '58c39049-154e-4773-a145-64bb9675049e'} May 09 04:26:28.614665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. (HTTP 404) (Request-ID: req-669bbe2b-136c-4f81-9f15-ec17f449a0c7) May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:28.615348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 04:26:28.617102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 04:26:28.617972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:26:28.620564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:28.620564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:28.620564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:28.620564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:28.620564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:28.620564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:26:28.620564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:26:28.620564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:26:28.620564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:26:28.620564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:28.620564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:26:28.620564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-eb7e68b6-e71b-45d2-abe6-b96a8a5ab9ed tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Returning 404 to user: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:26:28.620564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-eb7e68b6-e71b-45d2-abe6-b96a8a5ab9ed tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e" status: 404 len: 109 microversion: 2.1 time: 0.294402 May 09 04:26:28.620564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 23/33] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 04:26:28 2022] DELETE /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e => generated 109 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:26:28.628308 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-dc34bf6a-07e9-4272-9d07-b0a144b712ca tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:28.630944 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-dc34bf6a-07e9-4272-9d07-b0a144b712ca tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:28.652655 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dc34bf6a-07e9-4272-9d07-b0a144b712ca tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:28.653111 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dc34bf6a-07e9-4272-9d07-b0a144b712ca tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:28.653960 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dc34bf6a-07e9-4272-9d07-b0a144b712ca tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:28.654450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dc34bf6a-07e9-4272-9d07-b0a144b712ca tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:28.821455 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-dc34bf6a-07e9-4272-9d07-b0a144b712ca tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:28.838474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-dc34bf6a-07e9-4272-9d07-b0a144b712ca tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1272 microversion: 2.1 time: 0.218827 May 09 04:26:28.854283 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 24/34] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:28 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:28.860677 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-998310338", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97444843-38bb-4cb5-93cc-2ce85c9e2986"}], "security_groups": [{"name": "tempest-securitygroup--1555707672"}], "key_name": "tempest-keypair-872048384", "user_data": "}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:26:29.246358 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-e1773ab7-eb34-4b35-8ab5-93d1c8b5459d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Getting quotas for project 5e56ba7f9cc64897a1d95ac15061e9e4. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:26:29.254685 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-e1773ab7-eb34-4b35-8ab5-93d1c8b5459d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Getting quotas for user 4f8f6c77f898475e8acf1c4042c3928b and project 5e56ba7f9cc64897a1d95ac15061e9e4. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:26:29.287952 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e1773ab7-eb34-4b35-8ab5-93d1c8b5459d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.405958 May 09 04:26:29.288943 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 11/35] 10.222.0.44 () {62 vars in 1198 bytes} [Mon May 9 04:26:27 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1409 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 09 04:26:29.299327 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-af8a4606-8514-4ab1-ac73-7d4d608fef03 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Calling method '.version_select at 0x7fbfd4a6d310>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:29.352932 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-af8a4606-8514-4ab1-ac73-7d4d608fef03 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] HTTP exception thrown: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-af8a4606-8514-4ab1-ac73-7d4d608fef03 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Request method failure captured: May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e HTTP/1.1 May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJfkRF_nCACxFG_G-HbuVEQuVcQLD7D9l1lrxG4NkWsiw7OKOKIZHl_76R7OgMNxxcOpk7b878jxDpck06dLRTUISlB4X1CFZXs1OhV4pVmDkj5VKsRe8xeXpmYaShSqVGdlSFiMGtDQfyrkVuQDrg_sqasPjG-FXWpVLGFI6d9oB3g May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 4b289587284a4aba96b85ffec328efff May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1393918454 May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:26:29.355491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:26:29.356792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4b289587284a4aba96b85ffec328efff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b289587284a4aba96b85ffec328efff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b289587284a4aba96b85ffec328efff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4b289587284a4aba96b85ffec328efff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:26:29.356792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1393918454 May 09 04:26:29.356792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 4b289587284a4aba96b85ffec328efff May 09 04:26:29.356792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1393918454 May 09 04:26:29.356792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-VolumesSnapshotsTestJSON-1393918454-project May 09 04:26:29.356792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:26:29.356792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:26:29.356792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 3fd3e173caa849b98a2e58339001e0b7 May 09 04:26:29.356792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1393918454-project May 09 04:26:29.356792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: May 09 04:26:29.356792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:29.356792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '58c39049-154e-4773-a145-64bb9675049e'} May 09 04:26:29.356792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. (HTTP 404) (Request-ID: req-99c66835-6d54-4d36-8d80-f47b3248b704) May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:29.357555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 04:26:29.358670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 04:26:29.359703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:26:29.360902 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:29.360902 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:26:29.360902 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:26:29.360902 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:26:29.360902 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:26:29.360902 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:26:29.360902 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:26:29.360902 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:26:29.360902 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:26:29.360902 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. May 09 04:26:29.360902 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:26:29.361955 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-af8a4606-8514-4ab1-ac73-7d4d608fef03 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] Returning 404 to user: Volume 58c39049-154e-4773-a145-64bb9675049e could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:26:29.362899 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-af8a4606-8514-4ab1-ac73-7d4d608fef03 tempest-VolumesSnapshotsTestJSON-1393918454 tempest-VolumesSnapshotsTestJSON-1393918454-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e" status: 404 len: 109 microversion: 2.1 time: 0.067651 May 09 04:26:29.364197 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 12/36] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 04:26:29 2022] GET /compute/v2.1/os-volumes/58c39049-154e-4773-a145-64bb9675049e => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:26:29.447413 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.network.neutron [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] validate_networks() for [('97444843-38bb-4cb5-93cc-2ce85c9e2986', None, None, None, None, None)] {{(pid=117033) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:26:29.860899 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c6a389e0-5ad8-499e-b6f1-bd9b23f0eb18 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:29.861582 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c6a389e0-5ad8-499e-b6f1-bd9b23f0eb18 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:29.910280 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6a389e0-5ad8-499e-b6f1-bd9b23f0eb18 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:29.910774 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6a389e0-5ad8-499e-b6f1-bd9b23f0eb18 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:29.911607 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6a389e0-5ad8-499e-b6f1-bd9b23f0eb18 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:29.912456 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6a389e0-5ad8-499e-b6f1-bd9b23f0eb18 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:31.501416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c6a389e0-5ad8-499e-b6f1-bd9b23f0eb18 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:31.531912 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c6a389e0-5ad8-499e-b6f1-bd9b23f0eb18 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 1.674577 May 09 04:26:31.532450 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 13/37] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:29 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:26:32.549995 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ce5813dd-928d-4cd7-9c15-930d57bbb125 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:32.549995 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ce5813dd-928d-4cd7-9c15-930d57bbb125 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:32.564096 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ce5813dd-928d-4cd7-9c15-930d57bbb125 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:32.570393 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ce5813dd-928d-4cd7-9c15-930d57bbb125 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:32.571364 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ce5813dd-928d-4cd7-9c15-930d57bbb125 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:32.571921 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ce5813dd-928d-4cd7-9c15-930d57bbb125 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:32.647951 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Flavor limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:26:32.648646 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Image limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:26:32.649086 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Flavor pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:26:32.650215 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Image pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:26:32.650215 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:26:32.672781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:32.673605 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:32.674717 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:32.675355 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:32.730791 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Getting quotas for project 3c23c235fa1c4944bd7a337357d0c030. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:26:32.738769 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Getting quotas for user 85429c28c994443eb30b98ece56c4c9b and project 3c23c235fa1c4944bd7a337357d0c030. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:26:32.788262 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Going to run 1 instances... {{(pid=117033) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:26:32.791410 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:26:32.947021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6c887d42-31e0-499d-bb76-5cb5955a6beb tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.095803 May 09 04:26:32.951884 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 25/38] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:26:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 4101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:26:32.965015 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ead2f9b2-8b86-42e5-914d-3a4208496618 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:32.969860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ead2f9b2-8b86-42e5-914d-3a4208496618 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:33.387121 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ead2f9b2-8b86-42e5-914d-3a4208496618 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:33.419756 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ead2f9b2-8b86-42e5-914d-3a4208496618 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1236 microversion: 2.1 time: 0.453452 May 09 04:26:33.428521 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 26/39] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:32 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1236 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:26:34.443518 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-91ef67a2-a090-4f7d-b98e-52262fc4859e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:34.445014 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-91ef67a2-a090-4f7d-b98e-52262fc4859e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:34.639866 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ce5813dd-928d-4cd7-9c15-930d57bbb125 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:34.658028 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ce5813dd-928d-4cd7-9c15-930d57bbb125 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 2.105317 May 09 04:26:34.662799 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 14/40] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:32 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:34.758807 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-91ef67a2-a090-4f7d-b98e-52262fc4859e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:34.767066 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-91ef67a2-a090-4f7d-b98e-52262fc4859e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1236 microversion: 2.1 time: 0.328552 May 09 04:26:34.768645 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 27/41] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:34 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1236 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:26:35.677719 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-9396eb52-ed4b-4c22-b8d6-6ab4347d412d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:35.678408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-9396eb52-ed4b-4c22-b8d6-6ab4347d412d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:35.712825 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9396eb52-ed4b-4c22-b8d6-6ab4347d412d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:35.714611 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9396eb52-ed4b-4c22-b8d6-6ab4347d412d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:35.718970 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9396eb52-ed4b-4c22-b8d6-6ab4347d412d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:35.719431 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9396eb52-ed4b-4c22-b8d6-6ab4347d412d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:35.922153 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-92214499", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:26:36.102278 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] validate_networks() for [('9cb94923-1093-45fc-bebd-e159f3ac8dd3', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:26:36.383431 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9396eb52-ed4b-4c22-b8d6-6ab4347d412d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:36.390761 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-9396eb52-ed4b-4c22-b8d6-6ab4347d412d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.717525 May 09 04:26:36.404311 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 28/42] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:35 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:36.421449 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e00377d2-2347-40c6-b7aa-bfdd04ced414 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:36.422102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e00377d2-2347-40c6-b7aa-bfdd04ced414 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:36.444757 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e00377d2-2347-40c6-b7aa-bfdd04ced414 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:36.446148 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e00377d2-2347-40c6-b7aa-bfdd04ced414 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:36.447160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e00377d2-2347-40c6-b7aa-bfdd04ced414 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:36.448745 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e00377d2-2347-40c6-b7aa-bfdd04ced414 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:36.628636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e00377d2-2347-40c6-b7aa-bfdd04ced414 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:36.637684 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e00377d2-2347-40c6-b7aa-bfdd04ced414 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1288 microversion: 2.1 time: 0.231998 May 09 04:26:36.646527 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 29/43] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:36 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1288 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:36.656673 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1499533739", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "01d9e17c-6b96-4039-a582-d98ab8fe7760"}], "security_groups": [{"name": "tempest-securitygroup--2068591333"}], "key_name": "tempest-keypair-475241563", "user_data": "}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:26:36.948204 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.network.neutron [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] validate_networks() for [('01d9e17c-6b96-4039-a582-d98ab8fe7760', None, None, None, None, None)] {{(pid=117033) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:26:38.152265 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Flavor limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:26:38.152881 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Image limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:26:38.153136 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Flavor pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:26:38.153540 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Image pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:26:38.153950 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:26:38.171940 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:38.176175 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:38.178622 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:38.183404 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:38.245122 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Getting quotas for project 5e56ba7f9cc64897a1d95ac15061e9e4. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:26:38.252855 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Getting quotas for user 4f8f6c77f898475e8acf1c4042c3928b and project 5e56ba7f9cc64897a1d95ac15061e9e4. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:26:38.278978 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Going to run 1 instances... {{(pid=117033) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:26:38.282136 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:26:38.394829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6a0177b2-0cfe-43cb-a63e-8970f6446987 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.742136 May 09 04:26:38.395487 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 30/44] 10.222.0.44 () {62 vars in 1187 bytes} [Mon May 9 04:26:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 09 04:26:38.413485 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-18a5415d-ca6f-4674-8cae-1a698fb64ccc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:38.414119 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-18a5415d-ca6f-4674-8cae-1a698fb64ccc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:38.442349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18a5415d-ca6f-4674-8cae-1a698fb64ccc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:38.443009 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18a5415d-ca6f-4674-8cae-1a698fb64ccc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:38.443970 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18a5415d-ca6f-4674-8cae-1a698fb64ccc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:38.444406 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18a5415d-ca6f-4674-8cae-1a698fb64ccc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:38.951068 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-18a5415d-ca6f-4674-8cae-1a698fb64ccc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:38.959626 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-18a5415d-ca6f-4674-8cae-1a698fb64ccc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.562290 May 09 04:26:38.976245 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 31/45] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:38 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:39.014543 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d7a68b3e-847b-4c30-b698-f98fb0dc6b55 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:39.015182 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d7a68b3e-847b-4c30-b698-f98fb0dc6b55 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:39.053992 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d7a68b3e-847b-4c30-b698-f98fb0dc6b55 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:39.054533 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d7a68b3e-847b-4c30-b698-f98fb0dc6b55 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:39.055407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d7a68b3e-847b-4c30-b698-f98fb0dc6b55 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:39.055842 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d7a68b3e-847b-4c30-b698-f98fb0dc6b55 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:39.325560 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d7a68b3e-847b-4c30-b698-f98fb0dc6b55 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:39.368260 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d7a68b3e-847b-4c30-b698-f98fb0dc6b55 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1294 microversion: 2.1 time: 0.390298 May 09 04:26:39.368867 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 32/46] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:38 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1294 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:39.394971 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-73a8b904-5cd4-4dc5-a425-60db0ce7aa07 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:39.399806 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-73a8b904-5cd4-4dc5-a425-60db0ce7aa07 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:39.536178 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-73a8b904-5cd4-4dc5-a425-60db0ce7aa07 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:39.550609 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-73a8b904-5cd4-4dc5-a425-60db0ce7aa07 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:39.553631 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-73a8b904-5cd4-4dc5-a425-60db0ce7aa07 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:39.557447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-73a8b904-5cd4-4dc5-a425-60db0ce7aa07 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1281 microversion: 2.20 time: 0.174008 May 09 04:26:39.558943 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 33/47] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:26:39 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:26:40.241185 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-5a89ad87-3ce9-42a5-9726-8b40439b2d21 req-ae32387d-2eda-433a-baff-59b9c2018cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e2388e-186d-4ea8-94d7-5b9952abc60d", "tag": "7113abb1-73d9-40ca-bca3-339dc9e98ae7"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:26:40.279334 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-5a89ad87-3ce9-42a5-9726-8b40439b2d21 req-ae32387d-2eda-433a-baff-59b9c2018cbe service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:40.284087 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-5a89ad87-3ce9-42a5-9726-8b40439b2d21 req-ae32387d-2eda-433a-baff-59b9c2018cbe service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:40.392056 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-5a89ad87-3ce9-42a5-9726-8b40439b2d21 req-ae32387d-2eda-433a-baff-59b9c2018cbe service nova] Creating event network-changed:7113abb1-73d9-40ca-bca3-339dc9e98ae7 for instance 06e2388e-186d-4ea8-94d7-5b9952abc60d on hv-cinder-83800 May 09 04:26:40.392785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-5a89ad87-3ce9-42a5-9726-8b40439b2d21 req-ae32387d-2eda-433a-baff-59b9c2018cbe service nova] Acquired lock "compute-rpcapi-router" {{(pid=117033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 09 04:26:40.402601 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6b56dad-27eb-4078-aedf-80a48032af84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:40.403064 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6b56dad-27eb-4078-aedf-80a48032af84 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:40.403863 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6b56dad-27eb-4078-aedf-80a48032af84 None None] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:40.404326 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6b56dad-27eb-4078-aedf-80a48032af84 None None] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:40.481016 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.compute.rpcapi [None req-a6b56dad-27eb-4078-aedf-80a48032af84 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 09 04:26:40.481714 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6b56dad-27eb-4078-aedf-80a48032af84 None None] Releasing lock "compute-rpcapi-router" {{(pid=117033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 09 04:26:40.539166 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a6b56dad-27eb-4078-aedf-80a48032af84 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.960834 May 09 04:26:40.540901 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 34/48] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:26:40.558868 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-9a1f3451-5c89-48e8-bc99-01e1394267be tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:40.559595 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-9a1f3451-5c89-48e8-bc99-01e1394267be tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:40.593286 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9a1f3451-5c89-48e8-bc99-01e1394267be tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:40.595586 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9a1f3451-5c89-48e8-bc99-01e1394267be tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:40.601543 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9a1f3451-5c89-48e8-bc99-01e1394267be tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:40.604977 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9a1f3451-5c89-48e8-bc99-01e1394267be tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:41.277818 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:26:41.278377 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:26:41.278778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:26:41.279257 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:26:41.286938 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:26:41.312074 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:41.312990 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:41.314100 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:41.314833 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:41.401921 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Getting quotas for project d28d5139952d450fa3b7da38a62d7a03. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:26:41.431692 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Getting quotas for user 87b7c3ec77d4493dac92bb61d0b376be and project d28d5139952d450fa3b7da38a62d7a03. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:26:41.471511 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9a1f3451-5c89-48e8-bc99-01e1394267be tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:41.479047 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:26:41.483280 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-9a1f3451-5c89-48e8-bc99-01e1394267be tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.941082 May 09 04:26:41.484605 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:26:41.496790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 35/49] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:40 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:41.519201 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-52f9d494-9d80-480e-937e-9db50715c922 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:41.520667 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-52f9d494-9d80-480e-937e-9db50715c922 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:41.541099 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-52f9d494-9d80-480e-937e-9db50715c922 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:41.548937 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-52f9d494-9d80-480e-937e-9db50715c922 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:41.553070 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-52f9d494-9d80-480e-937e-9db50715c922 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:41.554714 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-52f9d494-9d80-480e-937e-9db50715c922 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:41.607360 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2b600d56-e725-4fa1-be7f-976872f8e021 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.952340 May 09 04:26:41.608231 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 15/50] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:26:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 5954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:26:41.618449 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3a5d039f-31dd-4313-83a6-0243415f9a7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:41.633208 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3a5d039f-31dd-4313-83a6-0243415f9a7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:41.641847 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a5d039f-31dd-4313-83a6-0243415f9a7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:41.642558 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a5d039f-31dd-4313-83a6-0243415f9a7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:41.643667 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a5d039f-31dd-4313-83a6-0243415f9a7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:41.644425 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a5d039f-31dd-4313-83a6-0243415f9a7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:41.821453 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-52f9d494-9d80-480e-937e-9db50715c922 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:41.848660 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-52f9d494-9d80-480e-937e-9db50715c922 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1294 microversion: 2.1 time: 0.340764 May 09 04:26:41.849511 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 36/51] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:41 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1294 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:41.867562 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8466591d-4ea3-4591-a4b3-7e006328836a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:41.869688 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8466591d-4ea3-4591-a4b3-7e006328836a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:42.151244 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3a5d039f-31dd-4313-83a6-0243415f9a7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:42.171955 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3a5d039f-31dd-4313-83a6-0243415f9a7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:42.175588 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3a5d039f-31dd-4313-83a6-0243415f9a7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:42.182422 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3a5d039f-31dd-4313-83a6-0243415f9a7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1339 microversion: 2.20 time: 0.565199 May 09 04:26:42.183853 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 16/52] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:26:41 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1339 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:26:42.300955 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8466591d-4ea3-4591-a4b3-7e006328836a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:42.310970 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8466591d-4ea3-4591-a4b3-7e006328836a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1220 microversion: 2.1 time: 0.459214 May 09 04:26:42.317029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 37/53] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:41 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1220 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:42.502804 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1a8f6b31-af8e-4cdc-8e8c-3eb161dde824 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:42.504247 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1a8f6b31-af8e-4cdc-8e8c-3eb161dde824 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:42.519246 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1a8f6b31-af8e-4cdc-8e8c-3eb161dde824 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:42.528906 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1a8f6b31-af8e-4cdc-8e8c-3eb161dde824 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:42.535379 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1a8f6b31-af8e-4cdc-8e8c-3eb161dde824 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:42.535850 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1a8f6b31-af8e-4cdc-8e8c-3eb161dde824 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:42.587602 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-517828627", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:26:42.789757 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.network.neutron [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] validate_networks() for [('9cb94923-1093-45fc-bebd-e159f3ac8dd3', None, None, None, None, None)] {{(pid=117033) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:26:43.825427 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1a8f6b31-af8e-4cdc-8e8c-3eb161dde824 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:43.840348 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1a8f6b31-af8e-4cdc-8e8c-3eb161dde824 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 1.342887 May 09 04:26:43.841869 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 17/54] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:42 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:43.855028 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-10b4f6a7-b5eb-4757-97cf-8e9548c1a417 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:43.858005 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-10b4f6a7-b5eb-4757-97cf-8e9548c1a417 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:43.905109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10b4f6a7-b5eb-4757-97cf-8e9548c1a417 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:43.906044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10b4f6a7-b5eb-4757-97cf-8e9548c1a417 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:43.906522 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10b4f6a7-b5eb-4757-97cf-8e9548c1a417 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:43.906961 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10b4f6a7-b5eb-4757-97cf-8e9548c1a417 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:45.332048 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-10b4f6a7-b5eb-4757-97cf-8e9548c1a417 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:45.341551 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-10b4f6a7-b5eb-4757-97cf-8e9548c1a417 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 1.497041 May 09 04:26:45.342357 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 18/55] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:43 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:45.357203 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1fdd2025-5e25-42d5-9cdd-eac7caf2c5ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:45.358166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1fdd2025-5e25-42d5-9cdd-eac7caf2c5ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:45.365364 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1fdd2025-5e25-42d5-9cdd-eac7caf2c5ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:45.366242 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1fdd2025-5e25-42d5-9cdd-eac7caf2c5ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:45.367253 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1fdd2025-5e25-42d5-9cdd-eac7caf2c5ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:45.367883 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1fdd2025-5e25-42d5-9cdd-eac7caf2c5ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:45.495457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1fdd2025-5e25-42d5-9cdd-eac7caf2c5ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:45.507858 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1fdd2025-5e25-42d5-9cdd-eac7caf2c5ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:45.510755 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1fdd2025-5e25-42d5-9cdd-eac7caf2c5ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:45.517593 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1fdd2025-5e25-42d5-9cdd-eac7caf2c5ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1339 microversion: 2.20 time: 0.158892 May 09 04:26:45.519961 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 19/56] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:26:45 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1339 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:26:45.533961 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a9feee04-1519-4cd5-bc06-45cfcbda034f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:45.535236 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a9feee04-1519-4cd5-bc06-45cfcbda034f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:45.551775 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9feee04-1519-4cd5-bc06-45cfcbda034f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:45.552783 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9feee04-1519-4cd5-bc06-45cfcbda034f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:45.554125 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9feee04-1519-4cd5-bc06-45cfcbda034f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:45.554950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9feee04-1519-4cd5-bc06-45cfcbda034f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:45.569893 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Flavor limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:26:45.570434 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Image limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:26:45.570847 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Flavor pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:26:45.571264 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Image pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:26:45.571826 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:26:45.616488 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:45.617762 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:45.620244 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:45.623106 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:45.651467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Getting quotas for project d28d5139952d450fa3b7da38a62d7a03. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:26:45.657586 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Getting quotas for user 87b7c3ec77d4493dac92bb61d0b376be and project d28d5139952d450fa3b7da38a62d7a03. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:26:45.672351 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Going to run 1 instances... {{(pid=117033) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:26:45.675020 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:26:45.765715 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-171cba6e-ca46-4283-8c53-540afeabd990 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.188165 May 09 04:26:45.767130 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 38/57] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:26:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 3190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:26:45.782802 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-789c9ae2-4d6c-4731-9e49-484261604291 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:45.783406 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-789c9ae2-4d6c-4731-9e49-484261604291 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:45.883798 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a9feee04-1519-4cd5-bc06-45cfcbda034f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:45.901685 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a9feee04-1519-4cd5-bc06-45cfcbda034f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.379925 May 09 04:26:45.902264 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 20/58] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:45 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:45.972102 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-0d09689c-dc70-4e2f-928c-e42ef3eb14e6 req-2ba82876-0835-44aa-bd62-eabc3ff76640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2923fc2-3ae0-4f89-b36c-193752581504", "tag": "7cfb4f53-5fec-4952-ba0d-117da0e35d2d"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:26:45.996963 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-0d09689c-dc70-4e2f-928c-e42ef3eb14e6 req-2ba82876-0835-44aa-bd62-eabc3ff76640 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:45.999861 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-0d09689c-dc70-4e2f-928c-e42ef3eb14e6 req-2ba82876-0835-44aa-bd62-eabc3ff76640 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:46.078783 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-0d09689c-dc70-4e2f-928c-e42ef3eb14e6 req-2ba82876-0835-44aa-bd62-eabc3ff76640 service nova] Creating event network-changed:7cfb4f53-5fec-4952-ba0d-117da0e35d2d for instance f2923fc2-3ae0-4f89-b36c-193752581504 on hv-cinder-83800 May 09 04:26:46.079333 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-0d09689c-dc70-4e2f-928c-e42ef3eb14e6 req-2ba82876-0835-44aa-bd62-eabc3ff76640 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 09 04:26:46.086406 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9badcf04-ec58-4182-ab06-40a223855c86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:46.086871 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9badcf04-ec58-4182-ab06-40a223855c86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:46.087698 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9badcf04-ec58-4182-ab06-40a223855c86 None None] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:46.088167 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9badcf04-ec58-4182-ab06-40a223855c86 None None] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:46.092801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-789c9ae2-4d6c-4731-9e49-484261604291 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:46.101044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-789c9ae2-4d6c-4731-9e49-484261604291 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1221 microversion: 2.1 time: 0.326189 May 09 04:26:46.103824 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 39/59] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:45 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1221 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:46.133136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.compute.rpcapi [None req-9badcf04-ec58-4182-ab06-40a223855c86 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 09 04:26:46.134244 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9badcf04-ec58-4182-ab06-40a223855c86 None None] Releasing lock "compute-rpcapi-router" {{(pid=117032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 09 04:26:46.185529 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9badcf04-ec58-4182-ab06-40a223855c86 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217160 May 09 04:26:46.193143 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 21/60] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:26:46.364220 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-9ba5d7d2-737f-4676-9f2f-b7f9df3729c9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:46.365601 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-9ba5d7d2-737f-4676-9f2f-b7f9df3729c9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:46.374378 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9ba5d7d2-737f-4676-9f2f-b7f9df3729c9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:46.375468 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9ba5d7d2-737f-4676-9f2f-b7f9df3729c9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:46.376732 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9ba5d7d2-737f-4676-9f2f-b7f9df3729c9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:46.377925 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9ba5d7d2-737f-4676-9f2f-b7f9df3729c9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:46.523609 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9ba5d7d2-737f-4676-9f2f-b7f9df3729c9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:46.531519 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-9ba5d7d2-737f-4676-9f2f-b7f9df3729c9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.173221 May 09 04:26:46.532125 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 40/61] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:46 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:46.538207 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-20b2e767-64f9-4d61-adba-ad73aa183bf2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:46.539524 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-20b2e767-64f9-4d61-adba-ad73aa183bf2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:46.546174 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-20b2e767-64f9-4d61-adba-ad73aa183bf2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:46.546624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-20b2e767-64f9-4d61-adba-ad73aa183bf2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:46.547389 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-20b2e767-64f9-4d61-adba-ad73aa183bf2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:46.547825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-20b2e767-64f9-4d61-adba-ad73aa183bf2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:46.680305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-20b2e767-64f9-4d61-adba-ad73aa183bf2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:46.687997 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-20b2e767-64f9-4d61-adba-ad73aa183bf2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:46.689497 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-20b2e767-64f9-4d61-adba-ad73aa183bf2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:46.690608 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-20b2e767-64f9-4d61-adba-ad73aa183bf2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.156870 May 09 04:26:46.691501 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 22/62] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:26:46 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:26:46.918584 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-0ca42cdb-6b1b-44ee-b7db-a8b9265116c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:46.919195 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-0ca42cdb-6b1b-44ee-b7db-a8b9265116c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:46.925009 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0ca42cdb-6b1b-44ee-b7db-a8b9265116c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:46.925450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0ca42cdb-6b1b-44ee-b7db-a8b9265116c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:46.926205 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0ca42cdb-6b1b-44ee-b7db-a8b9265116c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:46.926632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0ca42cdb-6b1b-44ee-b7db-a8b9265116c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:47.064238 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-0ca42cdb-6b1b-44ee-b7db-a8b9265116c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:47.071877 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-0ca42cdb-6b1b-44ee-b7db-a8b9265116c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.157053 May 09 04:26:47.072615 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 41/63] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:46 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:47.120868 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5ae412b0-4533-4078-9cdd-95532858357d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:47.121493 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5ae412b0-4533-4078-9cdd-95532858357d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:47.127328 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5ae412b0-4533-4078-9cdd-95532858357d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:47.127780 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5ae412b0-4533-4078-9cdd-95532858357d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:47.128582 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5ae412b0-4533-4078-9cdd-95532858357d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:47.129020 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5ae412b0-4533-4078-9cdd-95532858357d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:47.188874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5ae412b0-4533-4078-9cdd-95532858357d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:47.196378 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5ae412b0-4533-4078-9cdd-95532858357d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1225 microversion: 2.1 time: 0.079343 May 09 04:26:47.196945 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 23/64] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:47 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:26:47.548475 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-acdd2c1f-a4bc-47f4-8754-9bd2d487d433 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:47.549104 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-acdd2c1f-a4bc-47f4-8754-9bd2d487d433 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:47.555854 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-acdd2c1f-a4bc-47f4-8754-9bd2d487d433 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:47.556377 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-acdd2c1f-a4bc-47f4-8754-9bd2d487d433 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:47.557231 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-acdd2c1f-a4bc-47f4-8754-9bd2d487d433 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:47.557687 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-acdd2c1f-a4bc-47f4-8754-9bd2d487d433 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:47.710709 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6b3882eb-70ab-4bfc-ba87-0fd714065c2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:47.711512 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6b3882eb-70ab-4bfc-ba87-0fd714065c2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:47.717374 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6b3882eb-70ab-4bfc-ba87-0fd714065c2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:47.717854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6b3882eb-70ab-4bfc-ba87-0fd714065c2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:47.722315 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6b3882eb-70ab-4bfc-ba87-0fd714065c2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:47.722315 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6b3882eb-70ab-4bfc-ba87-0fd714065c2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:47.782016 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-acdd2c1f-a4bc-47f4-8754-9bd2d487d433 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:47.808609 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-acdd2c1f-a4bc-47f4-8754-9bd2d487d433 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.247643 May 09 04:26:47.809297 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 42/65] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:47 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:47.889990 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6b3882eb-70ab-4bfc-ba87-0fd714065c2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:47.897882 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6b3882eb-70ab-4bfc-ba87-0fd714065c2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:47.899395 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6b3882eb-70ab-4bfc-ba87-0fd714065c2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:47.900542 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6b3882eb-70ab-4bfc-ba87-0fd714065c2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.194138 May 09 04:26:47.901099 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 24/66] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:26:47 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:26:48.089341 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-831514ce-f70a-4622-bc71-c5d1dc92a9f8 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:48.089958 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-831514ce-f70a-4622-bc71-c5d1dc92a9f8 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:48.109208 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-831514ce-f70a-4622-bc71-c5d1dc92a9f8 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:48.109750 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-831514ce-f70a-4622-bc71-c5d1dc92a9f8 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:48.110841 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-831514ce-f70a-4622-bc71-c5d1dc92a9f8 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:48.111473 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-831514ce-f70a-4622-bc71-c5d1dc92a9f8 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:48.215354 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6e365f96-e2ec-4c01-9837-d69f30d47a36 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:48.215915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6e365f96-e2ec-4c01-9837-d69f30d47a36 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:48.222156 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6e365f96-e2ec-4c01-9837-d69f30d47a36 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:48.222612 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6e365f96-e2ec-4c01-9837-d69f30d47a36 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:48.223386 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6e365f96-e2ec-4c01-9837-d69f30d47a36 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:48.224742 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6e365f96-e2ec-4c01-9837-d69f30d47a36 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:48.294328 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6e365f96-e2ec-4c01-9837-d69f30d47a36 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:48.308928 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6e365f96-e2ec-4c01-9837-d69f30d47a36 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1225 microversion: 2.1 time: 0.098473 May 09 04:26:48.319102 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 25/67] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:48 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:26:48.465188 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-831514ce-f70a-4622-bc71-c5d1dc92a9f8 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:48.474759 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-831514ce-f70a-4622-bc71-c5d1dc92a9f8 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.389044 May 09 04:26:48.485733 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 43/68] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:48 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:48.826680 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b4718589-a4e7-4cad-bee5-9e2992af164e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:48.827749 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b4718589-a4e7-4cad-bee5-9e2992af164e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:48.834646 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b4718589-a4e7-4cad-bee5-9e2992af164e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:48.835239 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b4718589-a4e7-4cad-bee5-9e2992af164e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:48.836491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b4718589-a4e7-4cad-bee5-9e2992af164e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:48.837037 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b4718589-a4e7-4cad-bee5-9e2992af164e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:48.918444 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-091b85c1-5d5d-4db8-afcd-5fbfd4fcee18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:48.919177 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-091b85c1-5d5d-4db8-afcd-5fbfd4fcee18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:48.925534 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-091b85c1-5d5d-4db8-afcd-5fbfd4fcee18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:48.932628 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-091b85c1-5d5d-4db8-afcd-5fbfd4fcee18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:48.933496 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-091b85c1-5d5d-4db8-afcd-5fbfd4fcee18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:48.933944 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-091b85c1-5d5d-4db8-afcd-5fbfd4fcee18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:49.006189 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b4718589-a4e7-4cad-bee5-9e2992af164e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:49.014436 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b4718589-a4e7-4cad-bee5-9e2992af164e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.192002 May 09 04:26:49.015030 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 26/69] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:48 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:49.143434 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-091b85c1-5d5d-4db8-afcd-5fbfd4fcee18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:49.151638 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-091b85c1-5d5d-4db8-afcd-5fbfd4fcee18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:49.153168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-091b85c1-5d5d-4db8-afcd-5fbfd4fcee18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:49.154313 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-091b85c1-5d5d-4db8-afcd-5fbfd4fcee18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.239753 May 09 04:26:49.155105 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 44/70] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:26:48 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:26:49.193686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-93bb1d0a-2624-40a1-a633-49846ab31af1 req-fd51036b-006e-4cf4-9e08-8eb99133c46f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d10350c6-bf15-414f-9bf7-d371b6912be2", "tag": "2abd51b8-3b37-4ec3-841e-462a68eb5cbc"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:26:49.201621 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-93bb1d0a-2624-40a1-a633-49846ab31af1 req-fd51036b-006e-4cf4-9e08-8eb99133c46f service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:49.202009 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-93bb1d0a-2624-40a1-a633-49846ab31af1 req-fd51036b-006e-4cf4-9e08-8eb99133c46f service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:49.213126 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-93bb1d0a-2624-40a1-a633-49846ab31af1 req-fd51036b-006e-4cf4-9e08-8eb99133c46f service nova] Creating event network-changed:2abd51b8-3b37-4ec3-841e-462a68eb5cbc for instance d10350c6-bf15-414f-9bf7-d371b6912be2 on hv-cinder-83800 May 09 04:26:49.217785 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-93bb1d0a-2624-40a1-a633-49846ab31af1 req-fd51036b-006e-4cf4-9e08-8eb99133c46f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083089 May 09 04:26:49.218359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 27/71] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:26:49.326010 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d6a7fa13-efc5-4182-9a61-e6197b88b100 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:49.326544 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d6a7fa13-efc5-4182-9a61-e6197b88b100 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:49.332463 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d6a7fa13-efc5-4182-9a61-e6197b88b100 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:49.332911 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d6a7fa13-efc5-4182-9a61-e6197b88b100 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:49.333669 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d6a7fa13-efc5-4182-9a61-e6197b88b100 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:49.334101 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d6a7fa13-efc5-4182-9a61-e6197b88b100 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:49.394163 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d6a7fa13-efc5-4182-9a61-e6197b88b100 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:49.401700 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d6a7fa13-efc5-4182-9a61-e6197b88b100 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1225 microversion: 2.1 time: 0.079592 May 09 04:26:49.402265 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 45/72] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:49 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:49.492208 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-83ba62cc-9b8b-4f6c-8fb4-05d6a0e290c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:49.492917 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-83ba62cc-9b8b-4f6c-8fb4-05d6a0e290c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:49.499038 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-83ba62cc-9b8b-4f6c-8fb4-05d6a0e290c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:49.499484 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-83ba62cc-9b8b-4f6c-8fb4-05d6a0e290c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:49.500277 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-83ba62cc-9b8b-4f6c-8fb4-05d6a0e290c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:49.500710 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-83ba62cc-9b8b-4f6c-8fb4-05d6a0e290c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:49.627256 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-83ba62cc-9b8b-4f6c-8fb4-05d6a0e290c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:49.634773 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-83ba62cc-9b8b-4f6c-8fb4-05d6a0e290c0 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.147567 May 09 04:26:49.635337 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 28/73] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:49 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:50.031473 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1dac7aed-b586-472a-bd72-ead37d17a150 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:50.032104 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1dac7aed-b586-472a-bd72-ead37d17a150 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:50.038676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1dac7aed-b586-472a-bd72-ead37d17a150 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:50.039116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1dac7aed-b586-472a-bd72-ead37d17a150 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:50.039864 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1dac7aed-b586-472a-bd72-ead37d17a150 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:50.040318 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1dac7aed-b586-472a-bd72-ead37d17a150 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:50.172934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8b457ec9-45eb-4f7f-b7fb-e36ab4d83985 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:50.173715 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8b457ec9-45eb-4f7f-b7fb-e36ab4d83985 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:50.180119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b457ec9-45eb-4f7f-b7fb-e36ab4d83985 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:50.180572 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b457ec9-45eb-4f7f-b7fb-e36ab4d83985 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:50.181356 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b457ec9-45eb-4f7f-b7fb-e36ab4d83985 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:50.181793 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b457ec9-45eb-4f7f-b7fb-e36ab4d83985 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:50.317210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8b457ec9-45eb-4f7f-b7fb-e36ab4d83985 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:50.325644 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8b457ec9-45eb-4f7f-b7fb-e36ab4d83985 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:50.327164 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8b457ec9-45eb-4f7f-b7fb-e36ab4d83985 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:50.327749 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1dac7aed-b586-472a-bd72-ead37d17a150 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:50.328292 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8b457ec9-45eb-4f7f-b7fb-e36ab4d83985 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.159360 May 09 04:26:50.328852 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 29/74] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:26:50 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:26:50.335256 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1dac7aed-b586-472a-bd72-ead37d17a150 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.307578 May 09 04:26:50.336378 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 46/75] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:50 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:50.418428 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ff31b694-7b84-4970-9a64-6fb26bc0ef19 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:50.419041 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ff31b694-7b84-4970-9a64-6fb26bc0ef19 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:50.425177 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff31b694-7b84-4970-9a64-6fb26bc0ef19 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:50.425624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff31b694-7b84-4970-9a64-6fb26bc0ef19 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:50.426399 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff31b694-7b84-4970-9a64-6fb26bc0ef19 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:50.426921 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff31b694-7b84-4970-9a64-6fb26bc0ef19 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:50.488866 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ff31b694-7b84-4970-9a64-6fb26bc0ef19 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:50.496775 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ff31b694-7b84-4970-9a64-6fb26bc0ef19 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1225 microversion: 2.1 time: 0.082192 May 09 04:26:50.497346 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 30/76] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:50 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:50.650995 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-99aa184f-6d62-4785-87b6-1bfad63d36f2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:50.651545 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-99aa184f-6d62-4785-87b6-1bfad63d36f2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:50.657523 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-99aa184f-6d62-4785-87b6-1bfad63d36f2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:50.657972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-99aa184f-6d62-4785-87b6-1bfad63d36f2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:50.658736 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-99aa184f-6d62-4785-87b6-1bfad63d36f2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:50.659174 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-99aa184f-6d62-4785-87b6-1bfad63d36f2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:50.790369 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-99aa184f-6d62-4785-87b6-1bfad63d36f2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:50.797673 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-99aa184f-6d62-4785-87b6-1bfad63d36f2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.150593 May 09 04:26:50.798233 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 47/77] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:50 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:51.353427 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a79fcd76-709d-473b-80cf-ba6392cd302a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:51.354010 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f4cddb97-6be4-4a2a-b54e-cd9a0083f311 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:51.354614 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f4cddb97-6be4-4a2a-b54e-cd9a0083f311 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:51.355477 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a79fcd76-709d-473b-80cf-ba6392cd302a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:51.363496 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a79fcd76-709d-473b-80cf-ba6392cd302a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:51.364215 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a79fcd76-709d-473b-80cf-ba6392cd302a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:51.365638 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a79fcd76-709d-473b-80cf-ba6392cd302a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:51.365994 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f4cddb97-6be4-4a2a-b54e-cd9a0083f311 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:51.366447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a79fcd76-709d-473b-80cf-ba6392cd302a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:51.366730 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f4cddb97-6be4-4a2a-b54e-cd9a0083f311 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:51.371791 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f4cddb97-6be4-4a2a-b54e-cd9a0083f311 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:51.372714 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f4cddb97-6be4-4a2a-b54e-cd9a0083f311 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:51.518998 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f4cddb97-6be4-4a2a-b54e-cd9a0083f311 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:51.528000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f4cddb97-6be4-4a2a-b54e-cd9a0083f311 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:51.529510 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f4cddb97-6be4-4a2a-b54e-cd9a0083f311 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:51.530770 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f4cddb97-6be4-4a2a-b54e-cd9a0083f311 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.187781 May 09 04:26:51.531335 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 31/78] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:26:51 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:26:51.536795 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-51944b74-53e3-4028-8208-436edf8df596 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:51.537408 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-51944b74-53e3-4028-8208-436edf8df596 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:51.543226 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-51944b74-53e3-4028-8208-436edf8df596 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:51.543675 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-51944b74-53e3-4028-8208-436edf8df596 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:51.544496 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-51944b74-53e3-4028-8208-436edf8df596 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:51.544929 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-51944b74-53e3-4028-8208-436edf8df596 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:51.608503 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-51944b74-53e3-4028-8208-436edf8df596 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:51.616927 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a79fcd76-709d-473b-80cf-ba6392cd302a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:51.619638 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-51944b74-53e3-4028-8208-436edf8df596 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1217 microversion: 2.1 time: 0.086221 May 09 04:26:51.621005 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 32/79] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:51 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:51.626622 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-2a66ebce-fae7-4c2e-82ea-c18198992c3f req-b0f26279-6b46-4cb3-8498-c4182b51fd73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6774e618-8e5f-4815-8e60-0473be16aabc", "tag": "e75b43e2-a1dd-4d55-b4da-8e6449521a74"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:26:51.636966 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a79fcd76-709d-473b-80cf-ba6392cd302a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.288104 May 09 04:26:51.637886 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-2a66ebce-fae7-4c2e-82ea-c18198992c3f req-b0f26279-6b46-4cb3-8498-c4182b51fd73 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:51.638532 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-2a66ebce-fae7-4c2e-82ea-c18198992c3f req-b0f26279-6b46-4cb3-8498-c4182b51fd73 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:51.656165 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-2a66ebce-fae7-4c2e-82ea-c18198992c3f req-b0f26279-6b46-4cb3-8498-c4182b51fd73 service nova] Creating event network-changed:e75b43e2-a1dd-4d55-b4da-8e6449521a74 for instance 6774e618-8e5f-4815-8e60-0473be16aabc on hv-cinder-83800 May 09 04:26:51.658158 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 48/80] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:51 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:51.661746 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-2a66ebce-fae7-4c2e-82ea-c18198992c3f req-b0f26279-6b46-4cb3-8498-c4182b51fd73 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039363 May 09 04:26:51.662446 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 33/81] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:26:51.814598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-9388116e-e05a-48d2-96d0-1abdaf23aef2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:51.815308 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-9388116e-e05a-48d2-96d0-1abdaf23aef2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:51.828126 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9388116e-e05a-48d2-96d0-1abdaf23aef2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:51.828720 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9388116e-e05a-48d2-96d0-1abdaf23aef2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:51.829576 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9388116e-e05a-48d2-96d0-1abdaf23aef2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:51.830046 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9388116e-e05a-48d2-96d0-1abdaf23aef2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:51.968376 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9388116e-e05a-48d2-96d0-1abdaf23aef2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:51.977640 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-9388116e-e05a-48d2-96d0-1abdaf23aef2 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.166930 May 09 04:26:51.978527 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 49/82] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:51 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:52.554274 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5f74ef11-34b1-48b7-8deb-a026ff9f8b36 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:52.554979 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5f74ef11-34b1-48b7-8deb-a026ff9f8b36 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:52.561602 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f74ef11-34b1-48b7-8deb-a026ff9f8b36 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:52.562045 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f74ef11-34b1-48b7-8deb-a026ff9f8b36 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:52.562876 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f74ef11-34b1-48b7-8deb-a026ff9f8b36 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:52.563307 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f74ef11-34b1-48b7-8deb-a026ff9f8b36 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:52.637016 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-08cc62ab-92c3-4be8-9351-eb107890969d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:52.637618 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-08cc62ab-92c3-4be8-9351-eb107890969d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:52.643377 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-08cc62ab-92c3-4be8-9351-eb107890969d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:52.643820 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-08cc62ab-92c3-4be8-9351-eb107890969d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:52.644612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-08cc62ab-92c3-4be8-9351-eb107890969d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:52.645252 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-08cc62ab-92c3-4be8-9351-eb107890969d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:52.701241 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5f74ef11-34b1-48b7-8deb-a026ff9f8b36 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:52.709592 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5f74ef11-34b1-48b7-8deb-a026ff9f8b36 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:52.710107 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-08cc62ab-92c3-4be8-9351-eb107890969d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:52.711560 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5f74ef11-34b1-48b7-8deb-a026ff9f8b36 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:52.715509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5f74ef11-34b1-48b7-8deb-a026ff9f8b36 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.165519 May 09 04:26:52.718371 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-08cc62ab-92c3-4be8-9351-eb107890969d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1217 microversion: 2.1 time: 0.085080 May 09 04:26:52.723254 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 34/83] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:26:52 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:26:52.727930 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 50/84] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:52 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:26:52.728900 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-756bacd2-edbd-4411-89d0-3b92dfaef6f2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:52.729513 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-756bacd2-edbd-4411-89d0-3b92dfaef6f2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:52.735313 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-756bacd2-edbd-4411-89d0-3b92dfaef6f2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:52.735921 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-756bacd2-edbd-4411-89d0-3b92dfaef6f2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:52.736706 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-756bacd2-edbd-4411-89d0-3b92dfaef6f2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:52.737143 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-756bacd2-edbd-4411-89d0-3b92dfaef6f2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:52.894374 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-756bacd2-edbd-4411-89d0-3b92dfaef6f2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:52.902651 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-756bacd2-edbd-4411-89d0-3b92dfaef6f2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.177849 May 09 04:26:52.903354 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 35/85] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:52 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:52.993963 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5dd5fcb1-e8a4-4206-8cb1-14abb669117d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:52.994576 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5dd5fcb1-e8a4-4206-8cb1-14abb669117d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:53.000744 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5dd5fcb1-e8a4-4206-8cb1-14abb669117d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:53.001110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5dd5fcb1-e8a4-4206-8cb1-14abb669117d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:53.001864 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5dd5fcb1-e8a4-4206-8cb1-14abb669117d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:53.002772 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5dd5fcb1-e8a4-4206-8cb1-14abb669117d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:53.139353 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5dd5fcb1-e8a4-4206-8cb1-14abb669117d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:53.147574 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5dd5fcb1-e8a4-4206-8cb1-14abb669117d tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.157503 May 09 04:26:53.148158 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 51/86] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:52 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:53.730723 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-368a7c33-8c48-4ba6-b994-a5d441b4d08f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:53.731860 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-368a7c33-8c48-4ba6-b994-a5d441b4d08f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:53.734584 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d007ba05-e83a-4949-8982-7ab86bcfe907 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:53.735195 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d007ba05-e83a-4949-8982-7ab86bcfe907 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:53.739067 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-368a7c33-8c48-4ba6-b994-a5d441b4d08f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:53.740119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-368a7c33-8c48-4ba6-b994-a5d441b4d08f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:53.741124 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-368a7c33-8c48-4ba6-b994-a5d441b4d08f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:53.741742 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-368a7c33-8c48-4ba6-b994-a5d441b4d08f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:53.747500 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d007ba05-e83a-4949-8982-7ab86bcfe907 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:53.748067 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d007ba05-e83a-4949-8982-7ab86bcfe907 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:53.748866 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d007ba05-e83a-4949-8982-7ab86bcfe907 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:53.749310 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d007ba05-e83a-4949-8982-7ab86bcfe907 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:53.814247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d007ba05-e83a-4949-8982-7ab86bcfe907 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:53.823451 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d007ba05-e83a-4949-8982-7ab86bcfe907 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1217 microversion: 2.1 time: 0.092813 May 09 04:26:53.833305 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 52/87] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:53 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:53.886282 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-368a7c33-8c48-4ba6-b994-a5d441b4d08f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:53.894027 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-368a7c33-8c48-4ba6-b994-a5d441b4d08f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:53.895596 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-368a7c33-8c48-4ba6-b994-a5d441b4d08f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:53.896819 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-368a7c33-8c48-4ba6-b994-a5d441b4d08f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.170057 May 09 04:26:53.897373 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 36/88] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:26:53 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:26:53.920278 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3019026d-7808-42d5-84b5-69c432697c7d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:53.921115 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-3019026d-7808-42d5-84b5-69c432697c7d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:53.927767 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3019026d-7808-42d5-84b5-69c432697c7d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:53.928259 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3019026d-7808-42d5-84b5-69c432697c7d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:53.929030 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3019026d-7808-42d5-84b5-69c432697c7d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:53.929461 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3019026d-7808-42d5-84b5-69c432697c7d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:54.062027 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3019026d-7808-42d5-84b5-69c432697c7d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:54.070051 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-3019026d-7808-42d5-84b5-69c432697c7d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.153733 May 09 04:26:54.070619 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 53/89] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:53 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:54.166359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-54746bcc-1681-420b-8234-33c84cb824b9 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:54.167380 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-54746bcc-1681-420b-8234-33c84cb824b9 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:54.173821 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-54746bcc-1681-420b-8234-33c84cb824b9 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:54.174274 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-54746bcc-1681-420b-8234-33c84cb824b9 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:54.175468 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-54746bcc-1681-420b-8234-33c84cb824b9 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:54.176125 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-54746bcc-1681-420b-8234-33c84cb824b9 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:54.315751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-54746bcc-1681-420b-8234-33c84cb824b9 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:54.323594 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-54746bcc-1681-420b-8234-33c84cb824b9 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.162863 May 09 04:26:54.324204 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 37/90] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:54 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:54.840825 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6cde0065-8556-4dbb-b544-4bf266ae9586 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:54.841437 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6cde0065-8556-4dbb-b544-4bf266ae9586 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:54.872072 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6cde0065-8556-4dbb-b544-4bf266ae9586 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:54.873950 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6cde0065-8556-4dbb-b544-4bf266ae9586 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:54.874939 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6cde0065-8556-4dbb-b544-4bf266ae9586 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:54.877633 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6cde0065-8556-4dbb-b544-4bf266ae9586 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:54.915543 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bea4d51c-d38c-4f08-88ca-927a0c2f124f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:54.917459 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-bea4d51c-d38c-4f08-88ca-927a0c2f124f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:54.932208 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bea4d51c-d38c-4f08-88ca-927a0c2f124f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:54.932907 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bea4d51c-d38c-4f08-88ca-927a0c2f124f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:54.933920 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bea4d51c-d38c-4f08-88ca-927a0c2f124f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:54.946380 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bea4d51c-d38c-4f08-88ca-927a0c2f124f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:55.163637 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-6cde0065-8556-4dbb-b544-4bf266ae9586 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:55.184069 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6cde0065-8556-4dbb-b544-4bf266ae9586 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1273 microversion: 2.1 time: 0.346078 May 09 04:26:55.186308 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 54/91] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:54 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1273 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:55.202069 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b423cbe5-efe6-44bc-9671-1e0b29e40c71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:55.203849 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b423cbe5-efe6-44bc-9671-1e0b29e40c71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:55.216980 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b423cbe5-efe6-44bc-9671-1e0b29e40c71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:55.217830 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b423cbe5-efe6-44bc-9671-1e0b29e40c71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:55.218845 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b423cbe5-efe6-44bc-9671-1e0b29e40c71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:55.219538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b423cbe5-efe6-44bc-9671-1e0b29e40c71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:55.649198 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b423cbe5-efe6-44bc-9671-1e0b29e40c71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:55.665188 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b423cbe5-efe6-44bc-9671-1e0b29e40c71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.477166 May 09 04:26:55.665984 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 55/92] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:55 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:55.671847 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d032985a-ae6b-42b4-9893-90156bc16e7b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:55.673240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d032985a-ae6b-42b4-9893-90156bc16e7b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:55.683155 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d032985a-ae6b-42b4-9893-90156bc16e7b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:55.683778 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d032985a-ae6b-42b4-9893-90156bc16e7b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:55.683996 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bea4d51c-d38c-4f08-88ca-927a0c2f124f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:55.685059 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d032985a-ae6b-42b4-9893-90156bc16e7b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:55.685635 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d032985a-ae6b-42b4-9893-90156bc16e7b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:55.692099 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bea4d51c-d38c-4f08-88ca-927a0c2f124f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:55.694363 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bea4d51c-d38c-4f08-88ca-927a0c2f124f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:55.706185 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bea4d51c-d38c-4f08-88ca-927a0c2f124f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.794604 May 09 04:26:55.718459 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 38/93] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:26:54 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:26:55.838759 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d032985a-ae6b-42b4-9893-90156bc16e7b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:55.846606 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d032985a-ae6b-42b4-9893-90156bc16e7b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.179094 May 09 04:26:55.848407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 56/94] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:55 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:56.207112 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-82d0c67d-ebaf-4c12-974c-d7cb52709a58 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:56.209623 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-82d0c67d-ebaf-4c12-974c-d7cb52709a58 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:56.219461 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-82d0c67d-ebaf-4c12-974c-d7cb52709a58 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:56.220585 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-82d0c67d-ebaf-4c12-974c-d7cb52709a58 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:56.221669 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-82d0c67d-ebaf-4c12-974c-d7cb52709a58 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:56.222956 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-82d0c67d-ebaf-4c12-974c-d7cb52709a58 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:56.375929 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-82d0c67d-ebaf-4c12-974c-d7cb52709a58 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:56.388307 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-82d0c67d-ebaf-4c12-974c-d7cb52709a58 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1279 microversion: 2.1 time: 0.188735 May 09 04:26:56.388861 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 39/95] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:56 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1279 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:56.682759 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-03b04142-92aa-4bd5-9573-e3ddf2c2486f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:56.683656 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-03b04142-92aa-4bd5-9573-e3ddf2c2486f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:56.690120 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-03b04142-92aa-4bd5-9573-e3ddf2c2486f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:56.690936 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-03b04142-92aa-4bd5-9573-e3ddf2c2486f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:56.691888 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-03b04142-92aa-4bd5-9573-e3ddf2c2486f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:56.692437 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-03b04142-92aa-4bd5-9573-e3ddf2c2486f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:56.726322 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a8b7924d-becc-42c7-be17-5711481dd891 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:56.727158 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a8b7924d-becc-42c7-be17-5711481dd891 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:56.733228 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a8b7924d-becc-42c7-be17-5711481dd891 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:56.733697 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a8b7924d-becc-42c7-be17-5711481dd891 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:56.734465 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a8b7924d-becc-42c7-be17-5711481dd891 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:56.734909 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a8b7924d-becc-42c7-be17-5711481dd891 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:56.879572 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-03b04142-92aa-4bd5-9573-e3ddf2c2486f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:56.887964 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-03b04142-92aa-4bd5-9573-e3ddf2c2486f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.208977 May 09 04:26:56.888766 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 57/96] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:56 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:56.893238 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-fcb4f16d-bd00-4c4b-b50f-9174f5e880fc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:56.893908 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-fcb4f16d-bd00-4c4b-b50f-9174f5e880fc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:56.900235 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fcb4f16d-bd00-4c4b-b50f-9174f5e880fc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:56.900683 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fcb4f16d-bd00-4c4b-b50f-9174f5e880fc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:56.901439 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fcb4f16d-bd00-4c4b-b50f-9174f5e880fc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:56.901867 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fcb4f16d-bd00-4c4b-b50f-9174f5e880fc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:56.917052 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a8b7924d-becc-42c7-be17-5711481dd891 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:56.925687 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a8b7924d-becc-42c7-be17-5711481dd891 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:56.927609 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a8b7924d-becc-42c7-be17-5711481dd891 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:56.928940 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a8b7924d-becc-42c7-be17-5711481dd891 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.207342 May 09 04:26:56.929571 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 40/97] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:26:56 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:26:57.033136 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-fcb4f16d-bd00-4c4b-b50f-9174f5e880fc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:57.041261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-fcb4f16d-bd00-4c4b-b50f-9174f5e880fc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.151597 May 09 04:26:57.041837 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 58/98] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:56 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:57.405764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5223fce3-68e6-4879-9f3a-29b1565b2f5d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:57.406408 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5223fce3-68e6-4879-9f3a-29b1565b2f5d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:57.413400 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5223fce3-68e6-4879-9f3a-29b1565b2f5d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:57.414197 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5223fce3-68e6-4879-9f3a-29b1565b2f5d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:57.415113 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5223fce3-68e6-4879-9f3a-29b1565b2f5d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:57.415619 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5223fce3-68e6-4879-9f3a-29b1565b2f5d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:57.562197 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5223fce3-68e6-4879-9f3a-29b1565b2f5d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:57.570667 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5223fce3-68e6-4879-9f3a-29b1565b2f5d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.169059 May 09 04:26:57.571518 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 41/99] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:57 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:57.905091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3d9632e9-58e9-4538-b788-da852faa0ce4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:57.905826 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-3d9632e9-58e9-4538-b788-da852faa0ce4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:57.912247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3d9632e9-58e9-4538-b788-da852faa0ce4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:57.912764 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3d9632e9-58e9-4538-b788-da852faa0ce4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:57.913604 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3d9632e9-58e9-4538-b788-da852faa0ce4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:57.914112 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3d9632e9-58e9-4538-b788-da852faa0ce4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:57.947025 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a22ea334-bb03-494c-b656-b9e3c63e1ba9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:57.947633 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a22ea334-bb03-494c-b656-b9e3c63e1ba9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:57.953542 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a22ea334-bb03-494c-b656-b9e3c63e1ba9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:57.953991 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a22ea334-bb03-494c-b656-b9e3c63e1ba9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:57.954750 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a22ea334-bb03-494c-b656-b9e3c63e1ba9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:57.955184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a22ea334-bb03-494c-b656-b9e3c63e1ba9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:58.056617 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3d9632e9-58e9-4538-b788-da852faa0ce4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:58.064178 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-3d9632e9-58e9-4538-b788-da852faa0ce4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.162926 May 09 04:26:58.064757 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 59/100] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:57 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:58.069716 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-18d1d531-2faf-4bff-a370-603bb32db945 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:58.070481 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-18d1d531-2faf-4bff-a370-603bb32db945 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:58.076625 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18d1d531-2faf-4bff-a370-603bb32db945 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:58.077074 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18d1d531-2faf-4bff-a370-603bb32db945 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:58.077848 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18d1d531-2faf-4bff-a370-603bb32db945 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:58.078289 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18d1d531-2faf-4bff-a370-603bb32db945 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:58.101030 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a22ea334-bb03-494c-b656-b9e3c63e1ba9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:58.109183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a22ea334-bb03-494c-b656-b9e3c63e1ba9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:58.110936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a22ea334-bb03-494c-b656-b9e3c63e1ba9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:58.112084 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a22ea334-bb03-494c-b656-b9e3c63e1ba9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.169625 May 09 04:26:58.112644 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 42/101] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:26:57 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:26:58.207867 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-18d1d531-2faf-4bff-a370-603bb32db945 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:58.216027 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-18d1d531-2faf-4bff-a370-603bb32db945 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.149971 May 09 04:26:58.216596 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 60/102] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:58 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:58.589436 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9c6e37d4-126a-405c-83fd-680a726ddcde tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:58.600885 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9c6e37d4-126a-405c-83fd-680a726ddcde tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:58.615174 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c6e37d4-126a-405c-83fd-680a726ddcde tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:58.616359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c6e37d4-126a-405c-83fd-680a726ddcde tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:58.619746 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c6e37d4-126a-405c-83fd-680a726ddcde tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:58.620374 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c6e37d4-126a-405c-83fd-680a726ddcde tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:59.081046 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4df36ce6-84f0-4179-af0d-69c1563da4cd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:59.081684 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-4df36ce6-84f0-4179-af0d-69c1563da4cd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:59.112096 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4df36ce6-84f0-4179-af0d-69c1563da4cd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:59.112096 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4df36ce6-84f0-4179-af0d-69c1563da4cd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:59.113260 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4df36ce6-84f0-4179-af0d-69c1563da4cd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:59.115331 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4df36ce6-84f0-4179-af0d-69c1563da4cd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:59.351156 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9c6e37d4-126a-405c-83fd-680a726ddcde tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:59.370841 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9c6e37d4-126a-405c-83fd-680a726ddcde tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.784632 May 09 04:26:59.373392 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 43/103] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:58 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:59.388957 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3d2a92f1-0c06-423b-adc3-e4b22555f369 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:59.393237 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3d2a92f1-0c06-423b-adc3-e4b22555f369 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:59.416337 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3d2a92f1-0c06-423b-adc3-e4b22555f369 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:59.420570 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3d2a92f1-0c06-423b-adc3-e4b22555f369 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:59.424356 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3d2a92f1-0c06-423b-adc3-e4b22555f369 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:59.427546 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3d2a92f1-0c06-423b-adc3-e4b22555f369 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:59.560694 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4df36ce6-84f0-4179-af0d-69c1563da4cd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:59.572325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-4df36ce6-84f0-4179-af0d-69c1563da4cd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.495199 May 09 04:26:59.572985 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 61/104] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:59 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:26:59.595042 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b474d4ff-4623-4d6e-85e2-4d320f97585e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:26:59.596252 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b474d4ff-4623-4d6e-85e2-4d320f97585e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:26:59.608624 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b474d4ff-4623-4d6e-85e2-4d320f97585e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:59.609614 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b474d4ff-4623-4d6e-85e2-4d320f97585e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:59.610766 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b474d4ff-4623-4d6e-85e2-4d320f97585e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:26:59.611524 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b474d4ff-4623-4d6e-85e2-4d320f97585e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:26:59.846984 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b474d4ff-4623-4d6e-85e2-4d320f97585e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:59.858450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b474d4ff-4623-4d6e-85e2-4d320f97585e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.277452 May 09 04:26:59.859037 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 62/105] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:26:59 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:26:59.908230 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3d2a92f1-0c06-423b-adc3-e4b22555f369 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:59.916502 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3d2a92f1-0c06-423b-adc3-e4b22555f369 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:59.918447 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3d2a92f1-0c06-423b-adc3-e4b22555f369 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:26:59.919595 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3d2a92f1-0c06-423b-adc3-e4b22555f369 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.544419 May 09 04:26:59.920442 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 44/106] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:26:59 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:00.258731 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-41ce26e7-8851-4e26-acfe-d903fbd6fa00 req-8b09380b-773b-4856-bf72-8193718e4a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc9d45a-d1d9-4a28-8af9-4b6e14898436", "tag": "e798f1fa-3df7-4ec0-be2e-bf5db59b8036"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:27:00.268227 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-41ce26e7-8851-4e26-acfe-d903fbd6fa00 req-8b09380b-773b-4856-bf72-8193718e4a79 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:00.268916 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-41ce26e7-8851-4e26-acfe-d903fbd6fa00 req-8b09380b-773b-4856-bf72-8193718e4a79 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:00.282212 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-41ce26e7-8851-4e26-acfe-d903fbd6fa00 req-8b09380b-773b-4856-bf72-8193718e4a79 service nova] Creating event network-changed:e798f1fa-3df7-4ec0-be2e-bf5db59b8036 for instance 7fc9d45a-d1d9-4a28-8af9-4b6e14898436 on hv-cinder-83800 May 09 04:27:00.289442 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-41ce26e7-8851-4e26-acfe-d903fbd6fa00 req-8b09380b-773b-4856-bf72-8193718e4a79 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035029 May 09 04:27:00.293178 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 63/107] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:27:00.390746 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-af4da221-e925-467a-82cf-a51dcacc7ba8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:00.392462 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-af4da221-e925-467a-82cf-a51dcacc7ba8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:00.401742 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af4da221-e925-467a-82cf-a51dcacc7ba8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:00.402199 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af4da221-e925-467a-82cf-a51dcacc7ba8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:00.402987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af4da221-e925-467a-82cf-a51dcacc7ba8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:00.403424 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af4da221-e925-467a-82cf-a51dcacc7ba8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:00.587541 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-af4da221-e925-467a-82cf-a51dcacc7ba8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:00.596749 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d28424e9-1d14-4df7-9af2-5dd5f7db85a8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:00.597301 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d28424e9-1d14-4df7-9af2-5dd5f7db85a8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:00.599448 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-af4da221-e925-467a-82cf-a51dcacc7ba8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.210187 May 09 04:27:00.604620 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 45/108] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:00 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:00.610516 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d28424e9-1d14-4df7-9af2-5dd5f7db85a8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:00.610975 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d28424e9-1d14-4df7-9af2-5dd5f7db85a8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:00.611771 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d28424e9-1d14-4df7-9af2-5dd5f7db85a8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:00.612247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d28424e9-1d14-4df7-9af2-5dd5f7db85a8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:00.812465 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d28424e9-1d14-4df7-9af2-5dd5f7db85a8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:00.822447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d28424e9-1d14-4df7-9af2-5dd5f7db85a8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.231141 May 09 04:27:00.823978 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 64/109] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:00 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:27:00.874432 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-28d9c1eb-facf-4a3b-976d-7ae2f8b808aa tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:00.875044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-28d9c1eb-facf-4a3b-976d-7ae2f8b808aa tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:00.881733 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28d9c1eb-facf-4a3b-976d-7ae2f8b808aa tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:00.882177 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28d9c1eb-facf-4a3b-976d-7ae2f8b808aa tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:00.882945 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28d9c1eb-facf-4a3b-976d-7ae2f8b808aa tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:00.883373 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28d9c1eb-facf-4a3b-976d-7ae2f8b808aa tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:00.939608 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-75da2a48-aaf7-4637-9d37-e22dad32f23c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:00.940254 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-75da2a48-aaf7-4637-9d37-e22dad32f23c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:00.947549 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-75da2a48-aaf7-4637-9d37-e22dad32f23c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:00.947960 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-75da2a48-aaf7-4637-9d37-e22dad32f23c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:00.948939 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-75da2a48-aaf7-4637-9d37-e22dad32f23c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:00.949374 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-75da2a48-aaf7-4637-9d37-e22dad32f23c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:01.030469 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-28d9c1eb-facf-4a3b-976d-7ae2f8b808aa tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:01.038122 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-28d9c1eb-facf-4a3b-976d-7ae2f8b808aa tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.167341 May 09 04:27:01.038708 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 46/110] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:00 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:01.122838 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-75da2a48-aaf7-4637-9d37-e22dad32f23c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:01.131520 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-75da2a48-aaf7-4637-9d37-e22dad32f23c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:01.133045 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-75da2a48-aaf7-4637-9d37-e22dad32f23c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:01.134151 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-75da2a48-aaf7-4637-9d37-e22dad32f23c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.198990 May 09 04:27:01.134706 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 65/111] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:00 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:01.617149 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bb43c39a-180c-4182-83c6-a7a5bd73a7fa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:01.617851 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-bb43c39a-180c-4182-83c6-a7a5bd73a7fa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:01.623773 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bb43c39a-180c-4182-83c6-a7a5bd73a7fa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:01.624465 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bb43c39a-180c-4182-83c6-a7a5bd73a7fa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:01.625349 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bb43c39a-180c-4182-83c6-a7a5bd73a7fa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:01.625927 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bb43c39a-180c-4182-83c6-a7a5bd73a7fa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:01.775755 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bb43c39a-180c-4182-83c6-a7a5bd73a7fa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:01.784930 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bb43c39a-180c-4182-83c6-a7a5bd73a7fa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.171662 May 09 04:27:01.785913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 47/112] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:01 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:01.841994 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-db34b5ff-57fc-4a33-86ee-3ccd57918728 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:01.842842 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-db34b5ff-57fc-4a33-86ee-3ccd57918728 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:01.849442 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-db34b5ff-57fc-4a33-86ee-3ccd57918728 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:01.850004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-db34b5ff-57fc-4a33-86ee-3ccd57918728 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:01.851245 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-db34b5ff-57fc-4a33-86ee-3ccd57918728 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:01.851881 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-db34b5ff-57fc-4a33-86ee-3ccd57918728 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:02.011390 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-db34b5ff-57fc-4a33-86ee-3ccd57918728 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:02.019007 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-db34b5ff-57fc-4a33-86ee-3ccd57918728 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.181201 May 09 04:27:02.029090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 66/113] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:01 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:02.059281 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6029d511-c0b8-4c77-bb4e-d0fdc752bb54 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:02.060598 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6029d511-c0b8-4c77-bb4e-d0fdc752bb54 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:02.068163 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6029d511-c0b8-4c77-bb4e-d0fdc752bb54 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:02.068964 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6029d511-c0b8-4c77-bb4e-d0fdc752bb54 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:02.069754 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6029d511-c0b8-4c77-bb4e-d0fdc752bb54 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:02.070194 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6029d511-c0b8-4c77-bb4e-d0fdc752bb54 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:02.153694 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f5e8eb49-800c-400c-866b-604a39c6d121 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:02.154417 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f5e8eb49-800c-400c-866b-604a39c6d121 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:02.172825 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f5e8eb49-800c-400c-866b-604a39c6d121 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:02.173282 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f5e8eb49-800c-400c-866b-604a39c6d121 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:02.174056 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f5e8eb49-800c-400c-866b-604a39c6d121 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:02.174694 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f5e8eb49-800c-400c-866b-604a39c6d121 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:02.223050 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6029d511-c0b8-4c77-bb4e-d0fdc752bb54 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:02.230908 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6029d511-c0b8-4c77-bb4e-d0fdc752bb54 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.178885 May 09 04:27:02.231490 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 48/114] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:02 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:02.319149 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f5e8eb49-800c-400c-866b-604a39c6d121 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:02.328428 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f5e8eb49-800c-400c-866b-604a39c6d121 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:02.330365 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f5e8eb49-800c-400c-866b-604a39c6d121 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:02.331713 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f5e8eb49-800c-400c-866b-604a39c6d121 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.183021 May 09 04:27:02.332296 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 67/115] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:02 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:27:02.800994 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e30c3ff5-608d-478e-9e0c-bd28a8ed874b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:02.801589 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e30c3ff5-608d-478e-9e0c-bd28a8ed874b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:02.811541 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e30c3ff5-608d-478e-9e0c-bd28a8ed874b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:02.811814 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e30c3ff5-608d-478e-9e0c-bd28a8ed874b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:02.812631 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e30c3ff5-608d-478e-9e0c-bd28a8ed874b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:02.813077 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e30c3ff5-608d-478e-9e0c-bd28a8ed874b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:02.995921 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e30c3ff5-608d-478e-9e0c-bd28a8ed874b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:03.004585 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e30c3ff5-608d-478e-9e0c-bd28a8ed874b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.207525 May 09 04:27:03.007511 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 49/116] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:02 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:03.038110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-78c2f149-70a5-4763-9ed0-e75507ab7ec2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:03.038709 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-78c2f149-70a5-4763-9ed0-e75507ab7ec2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:03.046246 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-78c2f149-70a5-4763-9ed0-e75507ab7ec2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:03.046703 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-78c2f149-70a5-4763-9ed0-e75507ab7ec2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:03.048007 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-78c2f149-70a5-4763-9ed0-e75507ab7ec2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:03.048598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-78c2f149-70a5-4763-9ed0-e75507ab7ec2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:03.235069 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-78c2f149-70a5-4763-9ed0-e75507ab7ec2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:03.242760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-78c2f149-70a5-4763-9ed0-e75507ab7ec2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.209783 May 09 04:27:03.244413 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 68/117] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:03 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:27:03.248262 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-18c7b56c-2113-4427-8bc4-d9fb4c34e36f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:03.249737 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-18c7b56c-2113-4427-8bc4-d9fb4c34e36f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:03.259607 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18c7b56c-2113-4427-8bc4-d9fb4c34e36f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:03.260088 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18c7b56c-2113-4427-8bc4-d9fb4c34e36f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:03.260892 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18c7b56c-2113-4427-8bc4-d9fb4c34e36f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:03.261322 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18c7b56c-2113-4427-8bc4-d9fb4c34e36f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:03.320610 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-dbee3d97-84d3-420f-b2a0-1b9f0b302ac1 req-80f56a74-4acf-4d17-b826-b3a29c1bef29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e2388e-186d-4ea8-94d7-5b9952abc60d", "name": "network-vif-plugged", "status": "completed", "tag": "7113abb1-73d9-40ca-bca3-339dc9e98ae7"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:27:03.328851 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-dbee3d97-84d3-420f-b2a0-1b9f0b302ac1 req-80f56a74-4acf-4d17-b826-b3a29c1bef29 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:03.329402 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-dbee3d97-84d3-420f-b2a0-1b9f0b302ac1 req-80f56a74-4acf-4d17-b826-b3a29c1bef29 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:03.341987 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-dbee3d97-84d3-420f-b2a0-1b9f0b302ac1 req-80f56a74-4acf-4d17-b826-b3a29c1bef29 service nova] Creating event network-vif-plugged:7113abb1-73d9-40ca-bca3-339dc9e98ae7 for instance 06e2388e-186d-4ea8-94d7-5b9952abc60d on hv-cinder-83800 May 09 04:27:03.347471 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-dbee3d97-84d3-420f-b2a0-1b9f0b302ac1 req-80f56a74-4acf-4d17-b826-b3a29c1bef29 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089212 May 09 04:27:03.348540 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 69/118] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:27:03.360022 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-27b57135-d1b3-40aa-b837-5f3c0aed3c14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:03.360722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-27b57135-d1b3-40aa-b837-5f3c0aed3c14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:03.367419 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-27b57135-d1b3-40aa-b837-5f3c0aed3c14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:03.368095 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-27b57135-d1b3-40aa-b837-5f3c0aed3c14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:03.368881 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-27b57135-d1b3-40aa-b837-5f3c0aed3c14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:03.369322 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-27b57135-d1b3-40aa-b837-5f3c0aed3c14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:03.400680 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-18c7b56c-2113-4427-8bc4-d9fb4c34e36f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:03.410477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-18c7b56c-2113-4427-8bc4-d9fb4c34e36f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.166111 May 09 04:27:03.411676 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 50/119] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:03 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:27:03.501538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-27b57135-d1b3-40aa-b837-5f3c0aed3c14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:03.510685 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-27b57135-d1b3-40aa-b837-5f3c0aed3c14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:03.512505 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-27b57135-d1b3-40aa-b837-5f3c0aed3c14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:03.513618 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-27b57135-d1b3-40aa-b837-5f3c0aed3c14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.157674 May 09 04:27:03.514416 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 70/120] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:03 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:04.031235 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-10d39006-e422-4161-b2d1-33f1f9a1ccee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:04.032224 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-10d39006-e422-4161-b2d1-33f1f9a1ccee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:04.040215 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10d39006-e422-4161-b2d1-33f1f9a1ccee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:04.041214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10d39006-e422-4161-b2d1-33f1f9a1ccee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:04.042649 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10d39006-e422-4161-b2d1-33f1f9a1ccee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:04.043220 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10d39006-e422-4161-b2d1-33f1f9a1ccee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:04.178462 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-10d39006-e422-4161-b2d1-33f1f9a1ccee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:04.185662 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-10d39006-e422-4161-b2d1-33f1f9a1ccee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.160153 May 09 04:27:04.186216 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 51/121] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:04 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:04.260779 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5114f5b3-9abc-4f34-ab15-3db4c1bc626b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:04.261352 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5114f5b3-9abc-4f34-ab15-3db4c1bc626b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:04.267305 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5114f5b3-9abc-4f34-ab15-3db4c1bc626b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:04.267750 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5114f5b3-9abc-4f34-ab15-3db4c1bc626b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:04.268546 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5114f5b3-9abc-4f34-ab15-3db4c1bc626b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:04.268981 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5114f5b3-9abc-4f34-ab15-3db4c1bc626b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:04.394361 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5114f5b3-9abc-4f34-ab15-3db4c1bc626b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:04.402181 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5114f5b3-9abc-4f34-ab15-3db4c1bc626b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.145642 May 09 04:27:04.402747 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 71/122] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:04 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:04.430911 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bd217d42-9a55-4431-bdfc-842e11dfbeed tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:04.431627 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-bd217d42-9a55-4431-bdfc-842e11dfbeed tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:04.437528 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bd217d42-9a55-4431-bdfc-842e11dfbeed tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:04.437977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bd217d42-9a55-4431-bdfc-842e11dfbeed tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:04.438737 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bd217d42-9a55-4431-bdfc-842e11dfbeed tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:04.439175 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bd217d42-9a55-4431-bdfc-842e11dfbeed tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:04.531747 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d7af8da5-161a-4a72-93e2-734ded707567 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:04.532471 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d7af8da5-161a-4a72-93e2-734ded707567 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:04.538944 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d7af8da5-161a-4a72-93e2-734ded707567 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:04.539390 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d7af8da5-161a-4a72-93e2-734ded707567 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:04.540192 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d7af8da5-161a-4a72-93e2-734ded707567 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:04.540624 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d7af8da5-161a-4a72-93e2-734ded707567 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:04.564326 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bd217d42-9a55-4431-bdfc-842e11dfbeed tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:04.571779 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bd217d42-9a55-4431-bdfc-842e11dfbeed tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.145908 May 09 04:27:04.572397 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 52/123] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:04 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:27:04.664295 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d7af8da5-161a-4a72-93e2-734ded707567 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:04.671973 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d7af8da5-161a-4a72-93e2-734ded707567 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:04.673468 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d7af8da5-161a-4a72-93e2-734ded707567 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:04.674560 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d7af8da5-161a-4a72-93e2-734ded707567 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.146796 May 09 04:27:04.675121 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 72/124] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:04 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:05.201585 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c4a9c2b6-af6f-4b1f-a9d1-dd15331aade6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:05.202223 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c4a9c2b6-af6f-4b1f-a9d1-dd15331aade6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:05.208867 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4a9c2b6-af6f-4b1f-a9d1-dd15331aade6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:05.209324 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4a9c2b6-af6f-4b1f-a9d1-dd15331aade6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:05.210082 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4a9c2b6-af6f-4b1f-a9d1-dd15331aade6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:05.210509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4a9c2b6-af6f-4b1f-a9d1-dd15331aade6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:05.337617 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c4a9c2b6-af6f-4b1f-a9d1-dd15331aade6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:05.344783 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c4a9c2b6-af6f-4b1f-a9d1-dd15331aade6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.147106 May 09 04:27:05.345344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 53/125] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:05 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:05.419049 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-bf1760d7-00f5-44aa-a64f-3147d7638a1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:05.419658 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-bf1760d7-00f5-44aa-a64f-3147d7638a1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:05.425744 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bf1760d7-00f5-44aa-a64f-3147d7638a1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:05.426187 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bf1760d7-00f5-44aa-a64f-3147d7638a1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:05.427811 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bf1760d7-00f5-44aa-a64f-3147d7638a1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:05.428273 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bf1760d7-00f5-44aa-a64f-3147d7638a1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:05.554777 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-bf1760d7-00f5-44aa-a64f-3147d7638a1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:05.562351 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-bf1760d7-00f5-44aa-a64f-3147d7638a1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.147210 May 09 04:27:05.562917 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 73/126] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:05 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:05.587937 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5b12ea9b-f821-4825-8384-495dae584371 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:05.588558 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5b12ea9b-f821-4825-8384-495dae584371 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:05.594472 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b12ea9b-f821-4825-8384-495dae584371 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:05.594915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b12ea9b-f821-4825-8384-495dae584371 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:05.595680 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b12ea9b-f821-4825-8384-495dae584371 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:05.596150 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b12ea9b-f821-4825-8384-495dae584371 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:05.693301 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4a8c5780-3c4d-4941-9646-23b834e5ae1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:05.694022 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-4a8c5780-3c4d-4941-9646-23b834e5ae1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:05.701376 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4a8c5780-3c4d-4941-9646-23b834e5ae1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:05.701896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4a8c5780-3c4d-4941-9646-23b834e5ae1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:05.702656 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4a8c5780-3c4d-4941-9646-23b834e5ae1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:05.703087 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4a8c5780-3c4d-4941-9646-23b834e5ae1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:05.809996 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5b12ea9b-f821-4825-8384-495dae584371 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:05.818372 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5b12ea9b-f821-4825-8384-495dae584371 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.234480 May 09 04:27:05.819085 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 54/127] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:05 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:05.852093 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4a8c5780-3c4d-4941-9646-23b834e5ae1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:05.860068 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4a8c5780-3c4d-4941-9646-23b834e5ae1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:05.861545 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4a8c5780-3c4d-4941-9646-23b834e5ae1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:05.862642 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-4a8c5780-3c4d-4941-9646-23b834e5ae1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.173860 May 09 04:27:05.865469 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 74/128] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:05 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:27:06.362275 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a726a6cc-929c-41dc-984d-38af8a0e78b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:06.362275 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a726a6cc-929c-41dc-984d-38af8a0e78b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:06.369818 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a726a6cc-929c-41dc-984d-38af8a0e78b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:06.370445 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a726a6cc-929c-41dc-984d-38af8a0e78b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:06.371372 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a726a6cc-929c-41dc-984d-38af8a0e78b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:06.372081 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a726a6cc-929c-41dc-984d-38af8a0e78b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:06.571801 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a726a6cc-929c-41dc-984d-38af8a0e78b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:06.579661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e3d3d9b9-d338-417e-bf4a-110daaed4d04 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:06.580320 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e3d3d9b9-d338-417e-bf4a-110daaed4d04 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:06.583578 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a726a6cc-929c-41dc-984d-38af8a0e78b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.225454 May 09 04:27:06.584713 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 55/129] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:06 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:06.587485 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e3d3d9b9-d338-417e-bf4a-110daaed4d04 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:06.587976 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e3d3d9b9-d338-417e-bf4a-110daaed4d04 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:06.588751 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e3d3d9b9-d338-417e-bf4a-110daaed4d04 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:06.589248 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e3d3d9b9-d338-417e-bf4a-110daaed4d04 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:06.770303 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e3d3d9b9-d338-417e-bf4a-110daaed4d04 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:06.778520 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e3d3d9b9-d338-417e-bf4a-110daaed4d04 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.202577 May 09 04:27:06.779301 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 75/130] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:06 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:06.835034 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f10cec37-7ae1-44ca-ba96-d3ac8316faa6 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:06.836097 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f10cec37-7ae1-44ca-ba96-d3ac8316faa6 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:06.842027 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f10cec37-7ae1-44ca-ba96-d3ac8316faa6 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:06.842562 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f10cec37-7ae1-44ca-ba96-d3ac8316faa6 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:06.843387 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f10cec37-7ae1-44ca-ba96-d3ac8316faa6 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:06.843885 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f10cec37-7ae1-44ca-ba96-d3ac8316faa6 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:06.883086 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-aee470d3-514c-46bb-ad35-088007ff050d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:06.884168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-aee470d3-514c-46bb-ad35-088007ff050d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:06.890134 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aee470d3-514c-46bb-ad35-088007ff050d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:06.890577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aee470d3-514c-46bb-ad35-088007ff050d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:06.891342 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aee470d3-514c-46bb-ad35-088007ff050d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:06.891773 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aee470d3-514c-46bb-ad35-088007ff050d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:06.973335 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f10cec37-7ae1-44ca-ba96-d3ac8316faa6 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:06.981207 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f10cec37-7ae1-44ca-ba96-d3ac8316faa6 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.150469 May 09 04:27:06.981789 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 56/131] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:06 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:07.042997 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-aee470d3-514c-46bb-ad35-088007ff050d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:07.050844 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-aee470d3-514c-46bb-ad35-088007ff050d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:07.052884 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-aee470d3-514c-46bb-ad35-088007ff050d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:07.053998 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-aee470d3-514c-46bb-ad35-088007ff050d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.175406 May 09 04:27:07.054566 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 76/132] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:06 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:27:07.600877 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cb272673-a99b-40e1-aa4e-22c4dc0c5c57 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:07.601871 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-cb272673-a99b-40e1-aa4e-22c4dc0c5c57 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:07.608297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cb272673-a99b-40e1-aa4e-22c4dc0c5c57 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:07.608750 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cb272673-a99b-40e1-aa4e-22c4dc0c5c57 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:07.609509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cb272673-a99b-40e1-aa4e-22c4dc0c5c57 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:07.610102 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cb272673-a99b-40e1-aa4e-22c4dc0c5c57 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:07.773906 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-cb272673-a99b-40e1-aa4e-22c4dc0c5c57 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:07.781595 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-cb272673-a99b-40e1-aa4e-22c4dc0c5c57 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.185114 May 09 04:27:07.782154 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 57/133] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:07 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:07.797991 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-17c70d1d-c108-47bd-8e14-b68bcdb9ee53 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:07.798601 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-17c70d1d-c108-47bd-8e14-b68bcdb9ee53 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:07.805515 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-17c70d1d-c108-47bd-8e14-b68bcdb9ee53 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:07.806294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-17c70d1d-c108-47bd-8e14-b68bcdb9ee53 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:07.807282 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-17c70d1d-c108-47bd-8e14-b68bcdb9ee53 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:07.808379 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-17c70d1d-c108-47bd-8e14-b68bcdb9ee53 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:07.955708 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-17c70d1d-c108-47bd-8e14-b68bcdb9ee53 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:07.963289 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-17c70d1d-c108-47bd-8e14-b68bcdb9ee53 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.169127 May 09 04:27:07.967939 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 77/134] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:07 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:07.998478 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-256e9152-4219-4d13-b85e-09a55c705e5b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:07.999086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-256e9152-4219-4d13-b85e-09a55c705e5b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:08.005521 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-256e9152-4219-4d13-b85e-09a55c705e5b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:08.005964 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-256e9152-4219-4d13-b85e-09a55c705e5b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:08.006721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-256e9152-4219-4d13-b85e-09a55c705e5b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:08.007148 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-256e9152-4219-4d13-b85e-09a55c705e5b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:08.072321 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-aef6496c-1adf-4686-976f-819728ddb601 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:08.072861 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-aef6496c-1adf-4686-976f-819728ddb601 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:08.078774 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aef6496c-1adf-4686-976f-819728ddb601 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:08.079294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aef6496c-1adf-4686-976f-819728ddb601 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:08.080160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aef6496c-1adf-4686-976f-819728ddb601 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:08.080528 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aef6496c-1adf-4686-976f-819728ddb601 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:08.147156 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-256e9152-4219-4d13-b85e-09a55c705e5b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:08.154940 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-256e9152-4219-4d13-b85e-09a55c705e5b tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.160362 May 09 04:27:08.155504 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 58/135] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:07 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:08.218263 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-aef6496c-1adf-4686-976f-819728ddb601 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:08.226839 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-aef6496c-1adf-4686-976f-819728ddb601 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:08.228366 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-aef6496c-1adf-4686-976f-819728ddb601 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:08.229472 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-aef6496c-1adf-4686-976f-819728ddb601 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.162607 May 09 04:27:08.230027 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 78/136] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:08 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:08.798936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a4c5a493-1429-49e1-9185-9e800f88427e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:08.799635 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a4c5a493-1429-49e1-9185-9e800f88427e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:08.806350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a4c5a493-1429-49e1-9185-9e800f88427e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:08.806868 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a4c5a493-1429-49e1-9185-9e800f88427e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:08.807703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a4c5a493-1429-49e1-9185-9e800f88427e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:08.808284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a4c5a493-1429-49e1-9185-9e800f88427e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:08.934874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a4c5a493-1429-49e1-9185-9e800f88427e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:08.942493 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a4c5a493-1429-49e1-9185-9e800f88427e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.147727 May 09 04:27:08.943269 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 59/137] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:08 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:08.980139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-712e5131-8963-4170-889d-fd691d53d29b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:08.980754 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-712e5131-8963-4170-889d-fd691d53d29b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:08.986674 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-712e5131-8963-4170-889d-fd691d53d29b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:08.987121 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-712e5131-8963-4170-889d-fd691d53d29b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:08.987879 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-712e5131-8963-4170-889d-fd691d53d29b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:08.988333 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-712e5131-8963-4170-889d-fd691d53d29b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:09.115846 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-712e5131-8963-4170-889d-fd691d53d29b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:09.124624 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-712e5131-8963-4170-889d-fd691d53d29b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.148086 May 09 04:27:09.125091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 79/138] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:08 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:09.172172 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-938bdcfc-fe96-4d2c-a356-df5e63b0c434 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:09.173298 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-938bdcfc-fe96-4d2c-a356-df5e63b0c434 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:09.179554 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-938bdcfc-fe96-4d2c-a356-df5e63b0c434 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:09.180029 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-938bdcfc-fe96-4d2c-a356-df5e63b0c434 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:09.180783 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-938bdcfc-fe96-4d2c-a356-df5e63b0c434 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:09.181212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-938bdcfc-fe96-4d2c-a356-df5e63b0c434 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:09.247841 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-397fbdbe-40c2-4114-aebb-9eee5b9e40d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:09.248648 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-397fbdbe-40c2-4114-aebb-9eee5b9e40d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:09.255994 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-397fbdbe-40c2-4114-aebb-9eee5b9e40d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:09.256621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-397fbdbe-40c2-4114-aebb-9eee5b9e40d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:09.257577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-397fbdbe-40c2-4114-aebb-9eee5b9e40d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:09.258187 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-397fbdbe-40c2-4114-aebb-9eee5b9e40d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:09.320201 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-938bdcfc-fe96-4d2c-a356-df5e63b0c434 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:09.327798 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-938bdcfc-fe96-4d2c-a356-df5e63b0c434 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.159321 May 09 04:27:09.328416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 60/139] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:09 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:09.403208 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-397fbdbe-40c2-4114-aebb-9eee5b9e40d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:09.411614 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-397fbdbe-40c2-4114-aebb-9eee5b9e40d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:09.413167 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-397fbdbe-40c2-4114-aebb-9eee5b9e40d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:09.414267 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-397fbdbe-40c2-4114-aebb-9eee5b9e40d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.170456 May 09 04:27:09.414827 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 80/140] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:09 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:09.959703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d5f11715-2a3b-4084-8d4f-ffb349867a3a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:09.960333 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d5f11715-2a3b-4084-8d4f-ffb349867a3a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:09.966490 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d5f11715-2a3b-4084-8d4f-ffb349867a3a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:09.966931 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d5f11715-2a3b-4084-8d4f-ffb349867a3a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:09.967681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d5f11715-2a3b-4084-8d4f-ffb349867a3a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:09.968138 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d5f11715-2a3b-4084-8d4f-ffb349867a3a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:10.093630 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d5f11715-2a3b-4084-8d4f-ffb349867a3a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:10.101535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d5f11715-2a3b-4084-8d4f-ffb349867a3a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.146418 May 09 04:27:10.102090 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 61/141] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:09 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:10.141150 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-085d60be-f968-43e8-9015-4ba825286512 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:10.141765 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-085d60be-f968-43e8-9015-4ba825286512 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:10.148646 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-085d60be-f968-43e8-9015-4ba825286512 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:10.149093 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-085d60be-f968-43e8-9015-4ba825286512 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:10.149852 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-085d60be-f968-43e8-9015-4ba825286512 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:10.150286 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-085d60be-f968-43e8-9015-4ba825286512 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:10.277467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-085d60be-f968-43e8-9015-4ba825286512 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:10.284949 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-085d60be-f968-43e8-9015-4ba825286512 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.147601 May 09 04:27:10.285611 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 81/142] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:10 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:10.345870 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-40917dc1-2724-4514-a72e-1a78dba00ceb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:10.346518 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-40917dc1-2724-4514-a72e-1a78dba00ceb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:10.352634 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-40917dc1-2724-4514-a72e-1a78dba00ceb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:10.353074 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-40917dc1-2724-4514-a72e-1a78dba00ceb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:10.353825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-40917dc1-2724-4514-a72e-1a78dba00ceb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:10.354255 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-40917dc1-2724-4514-a72e-1a78dba00ceb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:10.432239 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3befa038-2ff3-41a8-a880-4575b5d83a25 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:10.432871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-3befa038-2ff3-41a8-a880-4575b5d83a25 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:10.441508 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3befa038-2ff3-41a8-a880-4575b5d83a25 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:10.441953 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3befa038-2ff3-41a8-a880-4575b5d83a25 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:10.443202 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3befa038-2ff3-41a8-a880-4575b5d83a25 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:10.443629 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3befa038-2ff3-41a8-a880-4575b5d83a25 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:10.481067 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-40917dc1-2724-4514-a72e-1a78dba00ceb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:10.490899 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-40917dc1-2724-4514-a72e-1a78dba00ceb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.148745 May 09 04:27:10.491479 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 62/143] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:10 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:10.576968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3befa038-2ff3-41a8-a880-4575b5d83a25 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:10.585630 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3befa038-2ff3-41a8-a880-4575b5d83a25 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:10.587375 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3befa038-2ff3-41a8-a880-4575b5d83a25 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:10.588530 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-3befa038-2ff3-41a8-a880-4575b5d83a25 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.160134 May 09 04:27:10.589087 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 82/144] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:10 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:27:11.118258 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2e7fcdf8-3ad9-432e-8224-72e0462fbf03 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:11.118862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2e7fcdf8-3ad9-432e-8224-72e0462fbf03 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:11.124900 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2e7fcdf8-3ad9-432e-8224-72e0462fbf03 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:11.125276 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2e7fcdf8-3ad9-432e-8224-72e0462fbf03 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:11.126020 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2e7fcdf8-3ad9-432e-8224-72e0462fbf03 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:11.126442 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2e7fcdf8-3ad9-432e-8224-72e0462fbf03 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:11.252472 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2e7fcdf8-3ad9-432e-8224-72e0462fbf03 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:11.259833 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2e7fcdf8-3ad9-432e-8224-72e0462fbf03 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.145980 May 09 04:27:11.260415 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 63/145] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:11 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:11.303470 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-7a830cf8-c93e-4ad8-8a77-746039c055af tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:11.304108 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-7a830cf8-c93e-4ad8-8a77-746039c055af tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:11.310041 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7a830cf8-c93e-4ad8-8a77-746039c055af tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:11.310490 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7a830cf8-c93e-4ad8-8a77-746039c055af tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:11.311248 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7a830cf8-c93e-4ad8-8a77-746039c055af tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:11.311680 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7a830cf8-c93e-4ad8-8a77-746039c055af tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:11.438390 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-7a830cf8-c93e-4ad8-8a77-746039c055af tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:11.445653 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-7a830cf8-c93e-4ad8-8a77-746039c055af tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.146658 May 09 04:27:11.446216 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 83/146] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:11 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:11.508092 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-38b9fdd6-3582-4717-a8ab-dfbf94ea496a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:11.508690 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-38b9fdd6-3582-4717-a8ab-dfbf94ea496a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:11.515194 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38b9fdd6-3582-4717-a8ab-dfbf94ea496a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:11.515642 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38b9fdd6-3582-4717-a8ab-dfbf94ea496a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:11.516451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38b9fdd6-3582-4717-a8ab-dfbf94ea496a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:11.516886 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38b9fdd6-3582-4717-a8ab-dfbf94ea496a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:11.607638 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-df1bf22a-807e-4a61-85f3-48ec53fd05f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:11.608289 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-df1bf22a-807e-4a61-85f3-48ec53fd05f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:11.614657 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df1bf22a-807e-4a61-85f3-48ec53fd05f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:11.615103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df1bf22a-807e-4a61-85f3-48ec53fd05f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:11.615866 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df1bf22a-807e-4a61-85f3-48ec53fd05f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:11.616343 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df1bf22a-807e-4a61-85f3-48ec53fd05f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:11.642660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-38b9fdd6-3582-4717-a8ab-dfbf94ea496a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:11.651566 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-38b9fdd6-3582-4717-a8ab-dfbf94ea496a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.147811 May 09 04:27:11.652801 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 64/147] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:11 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:11.745263 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-df1bf22a-807e-4a61-85f3-48ec53fd05f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:11.753129 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-df1bf22a-807e-4a61-85f3-48ec53fd05f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:11.754640 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-df1bf22a-807e-4a61-85f3-48ec53fd05f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:11.755775 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-df1bf22a-807e-4a61-85f3-48ec53fd05f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.151994 May 09 04:27:11.756361 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 84/148] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:11 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:27:12.276469 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5fc8a3f1-7cfe-4b08-9765-b5b8be549ecb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:12.277086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5fc8a3f1-7cfe-4b08-9765-b5b8be549ecb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:12.282977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5fc8a3f1-7cfe-4b08-9765-b5b8be549ecb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:12.283421 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5fc8a3f1-7cfe-4b08-9765-b5b8be549ecb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:12.284205 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5fc8a3f1-7cfe-4b08-9765-b5b8be549ecb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:12.284639 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5fc8a3f1-7cfe-4b08-9765-b5b8be549ecb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:12.414494 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5fc8a3f1-7cfe-4b08-9765-b5b8be549ecb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:12.421798 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5fc8a3f1-7cfe-4b08-9765-b5b8be549ecb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.149154 May 09 04:27:12.422380 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 65/149] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:12 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:12.462540 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-cc607ded-54db-4202-b0ea-32106b6b4c26 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:12.463152 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-cc607ded-54db-4202-b0ea-32106b6b4c26 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:12.469009 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cc607ded-54db-4202-b0ea-32106b6b4c26 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:12.469456 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cc607ded-54db-4202-b0ea-32106b6b4c26 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:12.470240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cc607ded-54db-4202-b0ea-32106b6b4c26 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:12.470676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cc607ded-54db-4202-b0ea-32106b6b4c26 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:12.670257 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3e3d7d61-1a36-4eb7-b26e-752496005890 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:12.670892 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3e3d7d61-1a36-4eb7-b26e-752496005890 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:12.679191 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e3d7d61-1a36-4eb7-b26e-752496005890 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:12.679699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e3d7d61-1a36-4eb7-b26e-752496005890 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:12.680793 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e3d7d61-1a36-4eb7-b26e-752496005890 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:12.681254 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e3d7d61-1a36-4eb7-b26e-752496005890 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:12.684743 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-cc607ded-54db-4202-b0ea-32106b6b4c26 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:12.698269 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-cc607ded-54db-4202-b0ea-32106b6b4c26 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.239734 May 09 04:27:12.707625 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 85/150] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:12 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:12.777069 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-212035f6-7c9d-4bd1-b224-1c232fcfc1ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:12.777794 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-212035f6-7c9d-4bd1-b224-1c232fcfc1ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:12.784303 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-212035f6-7c9d-4bd1-b224-1c232fcfc1ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:12.785175 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-212035f6-7c9d-4bd1-b224-1c232fcfc1ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:12.786607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-212035f6-7c9d-4bd1-b224-1c232fcfc1ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:12.787241 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-212035f6-7c9d-4bd1-b224-1c232fcfc1ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:12.871329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3e3d7d61-1a36-4eb7-b26e-752496005890 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:12.878615 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3e3d7d61-1a36-4eb7-b26e-752496005890 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.213821 May 09 04:27:12.879178 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 66/151] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:12 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:27:12.949772 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-212035f6-7c9d-4bd1-b224-1c232fcfc1ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:12.958607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-212035f6-7c9d-4bd1-b224-1c232fcfc1ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:12.960149 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-212035f6-7c9d-4bd1-b224-1c232fcfc1ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:12.961498 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-212035f6-7c9d-4bd1-b224-1c232fcfc1ac tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.191548 May 09 04:27:12.962051 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 86/152] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:12 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:27:13.438718 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6c4f4b82-bfb2-4136-8989-dba682991b15 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:13.439325 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6c4f4b82-bfb2-4136-8989-dba682991b15 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:13.445226 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c4f4b82-bfb2-4136-8989-dba682991b15 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:13.445669 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c4f4b82-bfb2-4136-8989-dba682991b15 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:13.446428 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c4f4b82-bfb2-4136-8989-dba682991b15 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:13.446859 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c4f4b82-bfb2-4136-8989-dba682991b15 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:13.575596 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6c4f4b82-bfb2-4136-8989-dba682991b15 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:13.583406 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6c4f4b82-bfb2-4136-8989-dba682991b15 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.148412 May 09 04:27:13.584003 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 67/153] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:13 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:13.716792 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d7bd8a78-3900-4483-aa79-aa10e774dc62 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:13.717415 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d7bd8a78-3900-4483-aa79-aa10e774dc62 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:13.724381 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d7bd8a78-3900-4483-aa79-aa10e774dc62 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:13.724834 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d7bd8a78-3900-4483-aa79-aa10e774dc62 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:13.725596 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d7bd8a78-3900-4483-aa79-aa10e774dc62 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:13.726029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d7bd8a78-3900-4483-aa79-aa10e774dc62 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:13.854336 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d7bd8a78-3900-4483-aa79-aa10e774dc62 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:13.861694 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d7bd8a78-3900-4483-aa79-aa10e774dc62 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.148866 May 09 04:27:13.862602 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 87/154] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:13 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:13.896594 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-45210883-adac-4bdd-9b96-1e84b9b09a7c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:13.897190 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-45210883-adac-4bdd-9b96-1e84b9b09a7c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:13.903076 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-45210883-adac-4bdd-9b96-1e84b9b09a7c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:13.903514 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-45210883-adac-4bdd-9b96-1e84b9b09a7c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:13.904365 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-45210883-adac-4bdd-9b96-1e84b9b09a7c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:13.904819 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-45210883-adac-4bdd-9b96-1e84b9b09a7c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:13.979357 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a7674680-c431-4d01-8e6d-a7c36f70f526 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:13.979985 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a7674680-c431-4d01-8e6d-a7c36f70f526 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:13.985924 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7674680-c431-4d01-8e6d-a7c36f70f526 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:13.986347 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7674680-c431-4d01-8e6d-a7c36f70f526 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:13.987098 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7674680-c431-4d01-8e6d-a7c36f70f526 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:13.987521 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7674680-c431-4d01-8e6d-a7c36f70f526 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:14.033308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-45210883-adac-4bdd-9b96-1e84b9b09a7c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:14.041758 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-45210883-adac-4bdd-9b96-1e84b9b09a7c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.149527 May 09 04:27:14.042525 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 68/155] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:13 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:14.113971 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a7674680-c431-4d01-8e6d-a7c36f70f526 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:14.121948 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a7674680-c431-4d01-8e6d-a7c36f70f526 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:14.123440 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a7674680-c431-4d01-8e6d-a7c36f70f526 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:14.124556 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a7674680-c431-4d01-8e6d-a7c36f70f526 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.149055 May 09 04:27:14.125095 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 88/156] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:13 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:27:14.600388 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-78689042-398c-4b6c-a4e1-1b8f7e1867d1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:14.600989 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-78689042-398c-4b6c-a4e1-1b8f7e1867d1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:14.606918 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78689042-398c-4b6c-a4e1-1b8f7e1867d1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:14.607358 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78689042-398c-4b6c-a4e1-1b8f7e1867d1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:14.608145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78689042-398c-4b6c-a4e1-1b8f7e1867d1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:14.608569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78689042-398c-4b6c-a4e1-1b8f7e1867d1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:14.734222 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-78689042-398c-4b6c-a4e1-1b8f7e1867d1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:14.742125 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-78689042-398c-4b6c-a4e1-1b8f7e1867d1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.145662 May 09 04:27:14.742811 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 69/157] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:14 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:14.878231 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4b5b6137-0db9-476f-84fc-5b5917e77ee3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:14.878844 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-4b5b6137-0db9-476f-84fc-5b5917e77ee3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:14.885106 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4b5b6137-0db9-476f-84fc-5b5917e77ee3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:14.885556 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4b5b6137-0db9-476f-84fc-5b5917e77ee3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:14.886351 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4b5b6137-0db9-476f-84fc-5b5917e77ee3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:14.886817 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4b5b6137-0db9-476f-84fc-5b5917e77ee3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:15.011146 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4b5b6137-0db9-476f-84fc-5b5917e77ee3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:15.018593 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-4b5b6137-0db9-476f-84fc-5b5917e77ee3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.144240 May 09 04:27:15.019162 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 89/158] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:14 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:15.058309 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a86c6982-125f-4bc4-9407-6b1239ec916c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:15.058950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a86c6982-125f-4bc4-9407-6b1239ec916c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:15.064993 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a86c6982-125f-4bc4-9407-6b1239ec916c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:15.065441 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a86c6982-125f-4bc4-9407-6b1239ec916c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:15.066205 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a86c6982-125f-4bc4-9407-6b1239ec916c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:15.066633 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a86c6982-125f-4bc4-9407-6b1239ec916c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:15.146256 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d39abc79-84c9-4001-a148-f1c48cf500be tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:15.147766 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d39abc79-84c9-4001-a148-f1c48cf500be tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:15.158706 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d39abc79-84c9-4001-a148-f1c48cf500be tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:15.159153 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d39abc79-84c9-4001-a148-f1c48cf500be tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:15.159935 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d39abc79-84c9-4001-a148-f1c48cf500be tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:15.160367 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d39abc79-84c9-4001-a148-f1c48cf500be tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:15.206204 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a86c6982-125f-4bc4-9407-6b1239ec916c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:15.219126 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a86c6982-125f-4bc4-9407-6b1239ec916c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.164526 May 09 04:27:15.228628 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 70/159] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:15 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:15.314838 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d39abc79-84c9-4001-a148-f1c48cf500be tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:15.323106 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d39abc79-84c9-4001-a148-f1c48cf500be tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:15.324635 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d39abc79-84c9-4001-a148-f1c48cf500be tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:15.325746 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d39abc79-84c9-4001-a148-f1c48cf500be tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.187203 May 09 04:27:15.326298 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 90/160] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:15 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:15.760970 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a11a0bdb-e9a1-4a61-87f6-320e12d2cf7c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:15.761765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a11a0bdb-e9a1-4a61-87f6-320e12d2cf7c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:15.768255 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a11a0bdb-e9a1-4a61-87f6-320e12d2cf7c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:15.768874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a11a0bdb-e9a1-4a61-87f6-320e12d2cf7c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:15.769835 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a11a0bdb-e9a1-4a61-87f6-320e12d2cf7c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:15.770980 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a11a0bdb-e9a1-4a61-87f6-320e12d2cf7c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:15.920898 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-ebc7fb78-87da-4217-bd4f-340c14e0ca30 req-dd14b022-5ac6-4d88-9bcc-3daff7ba198f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d10350c6-bf15-414f-9bf7-d371b6912be2", "name": "network-vif-plugged", "status": "completed", "tag": "2abd51b8-3b37-4ec3-841e-462a68eb5cbc"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:27:15.944264 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-ebc7fb78-87da-4217-bd4f-340c14e0ca30 req-dd14b022-5ac6-4d88-9bcc-3daff7ba198f service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:15.945276 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-ebc7fb78-87da-4217-bd4f-340c14e0ca30 req-dd14b022-5ac6-4d88-9bcc-3daff7ba198f service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:15.956368 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a11a0bdb-e9a1-4a61-87f6-320e12d2cf7c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:15.965906 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a11a0bdb-e9a1-4a61-87f6-320e12d2cf7c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.211154 May 09 04:27:15.966157 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-ebc7fb78-87da-4217-bd4f-340c14e0ca30 req-dd14b022-5ac6-4d88-9bcc-3daff7ba198f service nova] Creating event network-vif-plugged:2abd51b8-3b37-4ec3-841e-462a68eb5cbc for instance d10350c6-bf15-414f-9bf7-d371b6912be2 on hv-cinder-83800 May 09 04:27:15.967109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 71/161] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:15 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:15.974191 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-ebc7fb78-87da-4217-bd4f-340c14e0ca30 req-dd14b022-5ac6-4d88-9bcc-3daff7ba198f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058864 May 09 04:27:15.974963 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 91/162] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:27:16.034657 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-94933fff-c0c9-4a5b-b01a-93e496bcf41a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:16.035371 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-94933fff-c0c9-4a5b-b01a-93e496bcf41a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:16.041746 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94933fff-c0c9-4a5b-b01a-93e496bcf41a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:16.042603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94933fff-c0c9-4a5b-b01a-93e496bcf41a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:16.043560 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94933fff-c0c9-4a5b-b01a-93e496bcf41a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:16.044297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94933fff-c0c9-4a5b-b01a-93e496bcf41a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:16.218134 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-94933fff-c0c9-4a5b-b01a-93e496bcf41a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:16.230131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-94933fff-c0c9-4a5b-b01a-93e496bcf41a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.199077 May 09 04:27:16.231293 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 72/163] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:16 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:16.242237 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-289874d8-60ff-43f1-b8cc-e963bc07d62e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:16.243097 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-289874d8-60ff-43f1-b8cc-e963bc07d62e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:16.262143 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-289874d8-60ff-43f1-b8cc-e963bc07d62e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:16.262840 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-289874d8-60ff-43f1-b8cc-e963bc07d62e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:16.263754 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-289874d8-60ff-43f1-b8cc-e963bc07d62e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:16.265288 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-289874d8-60ff-43f1-b8cc-e963bc07d62e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:16.345408 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-771dd765-c214-4120-9d22-263c30d0b59c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:16.346540 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-771dd765-c214-4120-9d22-263c30d0b59c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:16.354846 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-771dd765-c214-4120-9d22-263c30d0b59c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:16.357340 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-771dd765-c214-4120-9d22-263c30d0b59c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:16.360224 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-771dd765-c214-4120-9d22-263c30d0b59c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:16.362915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-771dd765-c214-4120-9d22-263c30d0b59c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:16.558615 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-289874d8-60ff-43f1-b8cc-e963bc07d62e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:16.569222 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-289874d8-60ff-43f1-b8cc-e963bc07d62e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.335597 May 09 04:27:16.570717 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 92/164] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:16 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:16.594656 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-771dd765-c214-4120-9d22-263c30d0b59c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:16.603366 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-771dd765-c214-4120-9d22-263c30d0b59c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:16.604912 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-771dd765-c214-4120-9d22-263c30d0b59c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:16.606299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-771dd765-c214-4120-9d22-263c30d0b59c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.265282 May 09 04:27:16.607012 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 73/165] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:16 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:16.988546 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-71d423be-a0a2-4aa7-b03c-e51f90e49356 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:16.989842 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-71d423be-a0a2-4aa7-b03c-e51f90e49356 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:16.996819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-71d423be-a0a2-4aa7-b03c-e51f90e49356 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:16.997500 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-71d423be-a0a2-4aa7-b03c-e51f90e49356 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:16.998643 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-71d423be-a0a2-4aa7-b03c-e51f90e49356 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:16.999245 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-71d423be-a0a2-4aa7-b03c-e51f90e49356 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:17.184075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-71d423be-a0a2-4aa7-b03c-e51f90e49356 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:17.191290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-71d423be-a0a2-4aa7-b03c-e51f90e49356 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.206527 May 09 04:27:17.191887 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 93/166] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:16 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:17.247873 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9ea0e737-dc1b-4637-bac0-5fed08b55fe6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:17.248502 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9ea0e737-dc1b-4637-bac0-5fed08b55fe6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:17.257539 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9ea0e737-dc1b-4637-bac0-5fed08b55fe6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:17.257989 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9ea0e737-dc1b-4637-bac0-5fed08b55fe6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:17.258851 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9ea0e737-dc1b-4637-bac0-5fed08b55fe6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:17.259294 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9ea0e737-dc1b-4637-bac0-5fed08b55fe6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:17.471973 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9ea0e737-dc1b-4637-bac0-5fed08b55fe6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:17.479338 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9ea0e737-dc1b-4637-bac0-5fed08b55fe6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.235300 May 09 04:27:17.479964 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 74/167] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:17 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:17.587302 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8fa48d3a-3b9b-4557-9d45-0b6c13ffafc3 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:17.587934 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8fa48d3a-3b9b-4557-9d45-0b6c13ffafc3 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:17.593851 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8fa48d3a-3b9b-4557-9d45-0b6c13ffafc3 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:17.594297 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8fa48d3a-3b9b-4557-9d45-0b6c13ffafc3 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:17.595057 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8fa48d3a-3b9b-4557-9d45-0b6c13ffafc3 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:17.595487 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8fa48d3a-3b9b-4557-9d45-0b6c13ffafc3 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:17.624480 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-74ed4434-fb60-4f18-bb80-b5cd73382c38 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:17.625078 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-74ed4434-fb60-4f18-bb80-b5cd73382c38 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:17.633160 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74ed4434-fb60-4f18-bb80-b5cd73382c38 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:17.633600 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74ed4434-fb60-4f18-bb80-b5cd73382c38 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:17.634623 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74ed4434-fb60-4f18-bb80-b5cd73382c38 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:17.635120 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74ed4434-fb60-4f18-bb80-b5cd73382c38 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:17.781323 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-74ed4434-fb60-4f18-bb80-b5cd73382c38 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:17.791279 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-74ed4434-fb60-4f18-bb80-b5cd73382c38 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:17.793052 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-74ed4434-fb60-4f18-bb80-b5cd73382c38 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:17.794474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-74ed4434-fb60-4f18-bb80-b5cd73382c38 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.174201 May 09 04:27:17.802373 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 75/168] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:17 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:17.937001 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8fa48d3a-3b9b-4557-9d45-0b6c13ffafc3 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:17.945542 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8fa48d3a-3b9b-4557-9d45-0b6c13ffafc3 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.362513 May 09 04:27:17.946210 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 94/169] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:17 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:18.001407 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-5f848b4a-10da-45c5-b9cf-7ff18727e0e2 req-eb450f16-ad8b-4a34-a4e8-2b7560faf116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6774e618-8e5f-4815-8e60-0473be16aabc", "name": "network-vif-plugged", "status": "completed", "tag": "e75b43e2-a1dd-4d55-b4da-8e6449521a74"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:27:18.010650 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-5f848b4a-10da-45c5-b9cf-7ff18727e0e2 req-eb450f16-ad8b-4a34-a4e8-2b7560faf116 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:18.011163 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-5f848b4a-10da-45c5-b9cf-7ff18727e0e2 req-eb450f16-ad8b-4a34-a4e8-2b7560faf116 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:18.023289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-5f848b4a-10da-45c5-b9cf-7ff18727e0e2 req-eb450f16-ad8b-4a34-a4e8-2b7560faf116 service nova] Creating event network-vif-plugged:e75b43e2-a1dd-4d55-b4da-8e6449521a74 for instance 6774e618-8e5f-4815-8e60-0473be16aabc on hv-cinder-83800 May 09 04:27:18.028996 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-5f848b4a-10da-45c5-b9cf-7ff18727e0e2 req-eb450f16-ad8b-4a34-a4e8-2b7560faf116 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031302 May 09 04:27:18.029814 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 76/170] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:27:18.208509 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-96202965-298c-4bf6-b54e-12564f60e98b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:18.209641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-96202965-298c-4bf6-b54e-12564f60e98b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:18.216151 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-96202965-298c-4bf6-b54e-12564f60e98b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:18.216590 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-96202965-298c-4bf6-b54e-12564f60e98b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:18.217499 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-96202965-298c-4bf6-b54e-12564f60e98b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:18.217998 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-96202965-298c-4bf6-b54e-12564f60e98b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:18.347397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-96202965-298c-4bf6-b54e-12564f60e98b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:18.357898 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-96202965-298c-4bf6-b54e-12564f60e98b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.153302 May 09 04:27:18.358471 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 95/171] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:18 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:18.497430 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b15db76e-2fe7-49e1-92f8-1e0104597031 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:18.498246 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b15db76e-2fe7-49e1-92f8-1e0104597031 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:18.505206 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b15db76e-2fe7-49e1-92f8-1e0104597031 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:18.505746 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b15db76e-2fe7-49e1-92f8-1e0104597031 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:18.506520 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b15db76e-2fe7-49e1-92f8-1e0104597031 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:18.506966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b15db76e-2fe7-49e1-92f8-1e0104597031 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:18.643332 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b15db76e-2fe7-49e1-92f8-1e0104597031 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:18.651158 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b15db76e-2fe7-49e1-92f8-1e0104597031 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.158575 May 09 04:27:18.651737 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 77/172] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:18 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:18.812723 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a4a20a64-2067-405c-b3c5-837bc3e51af1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:18.813540 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a4a20a64-2067-405c-b3c5-837bc3e51af1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:18.819617 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a4a20a64-2067-405c-b3c5-837bc3e51af1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:18.820181 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a4a20a64-2067-405c-b3c5-837bc3e51af1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:18.821093 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a4a20a64-2067-405c-b3c5-837bc3e51af1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:18.821743 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a4a20a64-2067-405c-b3c5-837bc3e51af1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:18.948926 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a4a20a64-2067-405c-b3c5-837bc3e51af1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:18.959317 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a4a20a64-2067-405c-b3c5-837bc3e51af1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:18.961091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a4a20a64-2067-405c-b3c5-837bc3e51af1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:18.962201 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a4a20a64-2067-405c-b3c5-837bc3e51af1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.153405 May 09 04:27:18.962376 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d86f2267-f0c9-4bad-9ef6-e1c0e4da5d5c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:18.962745 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 96/173] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:18 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:18.963199 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d86f2267-f0c9-4bad-9ef6-e1c0e4da5d5c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:18.969126 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d86f2267-f0c9-4bad-9ef6-e1c0e4da5d5c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:18.969655 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d86f2267-f0c9-4bad-9ef6-e1c0e4da5d5c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:18.970471 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d86f2267-f0c9-4bad-9ef6-e1c0e4da5d5c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:18.970979 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d86f2267-f0c9-4bad-9ef6-e1c0e4da5d5c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:19.102397 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d86f2267-f0c9-4bad-9ef6-e1c0e4da5d5c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:19.110119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d86f2267-f0c9-4bad-9ef6-e1c0e4da5d5c tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.152623 May 09 04:27:19.110690 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 78/174] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:18 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:27:19.380988 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1d3350b6-d170-48f5-af08-3027f93cf699 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:19.381785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1d3350b6-d170-48f5-af08-3027f93cf699 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:19.387883 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1d3350b6-d170-48f5-af08-3027f93cf699 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:19.388366 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1d3350b6-d170-48f5-af08-3027f93cf699 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:19.389131 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1d3350b6-d170-48f5-af08-3027f93cf699 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:19.389561 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1d3350b6-d170-48f5-af08-3027f93cf699 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:19.533340 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1d3350b6-d170-48f5-af08-3027f93cf699 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:19.541271 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1d3350b6-d170-48f5-af08-3027f93cf699 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.168229 May 09 04:27:19.541851 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 97/175] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:19 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:27:19.669012 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a21b9c52-e563-4000-8fcf-2d6b1d64fa64 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:19.670548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a21b9c52-e563-4000-8fcf-2d6b1d64fa64 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:19.684143 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a21b9c52-e563-4000-8fcf-2d6b1d64fa64 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:19.684589 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a21b9c52-e563-4000-8fcf-2d6b1d64fa64 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:19.685476 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a21b9c52-e563-4000-8fcf-2d6b1d64fa64 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:19.686001 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a21b9c52-e563-4000-8fcf-2d6b1d64fa64 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:19.824099 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a21b9c52-e563-4000-8fcf-2d6b1d64fa64 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:19.833231 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a21b9c52-e563-4000-8fcf-2d6b1d64fa64 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.168487 May 09 04:27:19.834490 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 79/176] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:19 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:19.980780 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-71f16481-3c38-4138-9fd6-13f2ae7713d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:19.981429 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-71f16481-3c38-4138-9fd6-13f2ae7713d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:19.987934 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-71f16481-3c38-4138-9fd6-13f2ae7713d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:19.988388 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-71f16481-3c38-4138-9fd6-13f2ae7713d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:19.989435 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-71f16481-3c38-4138-9fd6-13f2ae7713d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:19.989951 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-71f16481-3c38-4138-9fd6-13f2ae7713d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:20.046171 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-79f93a70-dc3e-4c60-a292-788da25c1a60 req-09ac811d-fcc6-4667-9a90-3ed2e17f4dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2923fc2-3ae0-4f89-b36c-193752581504", "name": "network-vif-plugged", "status": "completed", "tag": "7cfb4f53-5fec-4952-ba0d-117da0e35d2d"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:27:20.054332 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-79f93a70-dc3e-4c60-a292-788da25c1a60 req-09ac811d-fcc6-4667-9a90-3ed2e17f4dee service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:20.054817 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-79f93a70-dc3e-4c60-a292-788da25c1a60 req-09ac811d-fcc6-4667-9a90-3ed2e17f4dee service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:20.065814 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-79f93a70-dc3e-4c60-a292-788da25c1a60 req-09ac811d-fcc6-4667-9a90-3ed2e17f4dee service nova] Creating event network-vif-plugged:7cfb4f53-5fec-4952-ba0d-117da0e35d2d for instance f2923fc2-3ae0-4f89-b36c-193752581504 on hv-cinder-83800 May 09 04:27:20.071699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-79f93a70-dc3e-4c60-a292-788da25c1a60 req-09ac811d-fcc6-4667-9a90-3ed2e17f4dee service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029087 May 09 04:27:20.072334 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 80/177] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:27:20.119697 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-71f16481-3c38-4138-9fd6-13f2ae7713d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:20.127015 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-18fbea8e-d414-44df-be9e-5ed70a0df3bb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:20.127677 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-71f16481-3c38-4138-9fd6-13f2ae7713d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:20.127849 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-18fbea8e-d414-44df-be9e-5ed70a0df3bb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:20.130033 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-71f16481-3c38-4138-9fd6-13f2ae7713d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:20.131154 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-71f16481-3c38-4138-9fd6-13f2ae7713d6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.154612 May 09 04:27:20.134649 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18fbea8e-d414-44df-be9e-5ed70a0df3bb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:20.135093 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18fbea8e-d414-44df-be9e-5ed70a0df3bb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:20.135852 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18fbea8e-d414-44df-be9e-5ed70a0df3bb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:20.136303 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18fbea8e-d414-44df-be9e-5ed70a0df3bb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:20.141434 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 98/178] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:19 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:20.269299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-18fbea8e-d414-44df-be9e-5ed70a0df3bb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:20.277694 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-18fbea8e-d414-44df-be9e-5ed70a0df3bb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1314 microversion: 2.1 time: 0.154663 May 09 04:27:20.278262 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 81/179] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:20 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:27:20.560009 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b3ee0328-038a-497c-bcbf-5b5e618dae48 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:20.561350 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b3ee0328-038a-497c-bcbf-5b5e618dae48 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:20.570102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b3ee0328-038a-497c-bcbf-5b5e618dae48 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:20.570912 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b3ee0328-038a-497c-bcbf-5b5e618dae48 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:20.572633 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b3ee0328-038a-497c-bcbf-5b5e618dae48 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:20.573065 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b3ee0328-038a-497c-bcbf-5b5e618dae48 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:20.736125 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b3ee0328-038a-497c-bcbf-5b5e618dae48 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:20.744443 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b3ee0328-038a-497c-bcbf-5b5e618dae48 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.190508 May 09 04:27:20.745110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 99/180] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:20 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:20.851610 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f51d837e-5141-4a68-beb8-c36e678d135f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:20.852260 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f51d837e-5141-4a68-beb8-c36e678d135f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:20.858515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f51d837e-5141-4a68-beb8-c36e678d135f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:20.858977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f51d837e-5141-4a68-beb8-c36e678d135f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:20.859750 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f51d837e-5141-4a68-beb8-c36e678d135f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:20.860263 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f51d837e-5141-4a68-beb8-c36e678d135f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:21.006344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f51d837e-5141-4a68-beb8-c36e678d135f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:21.013599 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f51d837e-5141-4a68-beb8-c36e678d135f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.166757 May 09 04:27:21.014161 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 82/181] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:20 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:21.149761 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-df611177-e2a4-4541-ac03-31a5bfdba996 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:21.150277 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-df611177-e2a4-4541-ac03-31a5bfdba996 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:21.156300 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df611177-e2a4-4541-ac03-31a5bfdba996 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:21.156779 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df611177-e2a4-4541-ac03-31a5bfdba996 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:21.157539 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df611177-e2a4-4541-ac03-31a5bfdba996 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:21.157978 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df611177-e2a4-4541-ac03-31a5bfdba996 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:21.283753 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-df611177-e2a4-4541-ac03-31a5bfdba996 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:21.291932 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-df611177-e2a4-4541-ac03-31a5bfdba996 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:21.293474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-df611177-e2a4-4541-ac03-31a5bfdba996 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:21.294182 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d8416e8d-3c4c-4da8-bba3-1f8b195800cc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:21.294583 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-df611177-e2a4-4541-ac03-31a5bfdba996 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.149600 May 09 04:27:21.294826 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d8416e8d-3c4c-4da8-bba3-1f8b195800cc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:21.295142 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 100/182] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:21 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:21.300774 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d8416e8d-3c4c-4da8-bba3-1f8b195800cc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:21.301222 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d8416e8d-3c4c-4da8-bba3-1f8b195800cc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:21.301991 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d8416e8d-3c4c-4da8-bba3-1f8b195800cc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:21.303163 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d8416e8d-3c4c-4da8-bba3-1f8b195800cc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:21.435007 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d8416e8d-3c4c-4da8-bba3-1f8b195800cc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:21.442398 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d8416e8d-3c4c-4da8-bba3-1f8b195800cc tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1501 microversion: 2.1 time: 0.151949 May 09 04:27:21.442966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 83/183] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:21 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:27:21.761701 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d5632570-bb95-4d2e-8b40-5074db986be4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:21.762312 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d5632570-bb95-4d2e-8b40-5074db986be4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:21.768304 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d5632570-bb95-4d2e-8b40-5074db986be4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:21.768756 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d5632570-bb95-4d2e-8b40-5074db986be4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:21.769529 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d5632570-bb95-4d2e-8b40-5074db986be4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:21.769963 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d5632570-bb95-4d2e-8b40-5074db986be4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:21.936036 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d5632570-bb95-4d2e-8b40-5074db986be4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:21.946235 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d5632570-bb95-4d2e-8b40-5074db986be4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.185297 May 09 04:27:21.955882 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 101/184] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:21 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:22.031105 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8cd7dced-7651-4c3c-a1c5-e63999603f95 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:22.032538 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8cd7dced-7651-4c3c-a1c5-e63999603f95 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:22.039859 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8cd7dced-7651-4c3c-a1c5-e63999603f95 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:22.040663 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8cd7dced-7651-4c3c-a1c5-e63999603f95 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:22.041576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8cd7dced-7651-4c3c-a1c5-e63999603f95 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:22.042309 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8cd7dced-7651-4c3c-a1c5-e63999603f95 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:22.188784 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8cd7dced-7651-4c3c-a1c5-e63999603f95 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:22.196162 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8cd7dced-7651-4c3c-a1c5-e63999603f95 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.169520 May 09 04:27:22.196737 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 84/185] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:22 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:22.312822 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-06062312-4a4d-4508-bdab-61869ae8a99e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:22.313516 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-06062312-4a4d-4508-bdab-61869ae8a99e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:22.319517 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-06062312-4a4d-4508-bdab-61869ae8a99e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:22.319986 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-06062312-4a4d-4508-bdab-61869ae8a99e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:22.320918 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-06062312-4a4d-4508-bdab-61869ae8a99e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:22.321502 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-06062312-4a4d-4508-bdab-61869ae8a99e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:22.457615 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-06062312-4a4d-4508-bdab-61869ae8a99e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:22.466481 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-06062312-4a4d-4508-bdab-61869ae8a99e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:22.467982 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-06062312-4a4d-4508-bdab-61869ae8a99e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:22.469064 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-06062312-4a4d-4508-bdab-61869ae8a99e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.160194 May 09 04:27:22.469621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 102/186] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:22 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:22.963708 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8927b494-c71d-471e-8482-aaa9f13c9fbb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:22.963708 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8927b494-c71d-471e-8482-aaa9f13c9fbb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:22.969486 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8927b494-c71d-471e-8482-aaa9f13c9fbb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:22.969935 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8927b494-c71d-471e-8482-aaa9f13c9fbb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:22.970697 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8927b494-c71d-471e-8482-aaa9f13c9fbb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:22.971137 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8927b494-c71d-471e-8482-aaa9f13c9fbb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:23.097641 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8927b494-c71d-471e-8482-aaa9f13c9fbb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:23.105318 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8927b494-c71d-471e-8482-aaa9f13c9fbb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.146481 May 09 04:27:23.105883 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 85/187] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:22 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:23.213106 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-cd7354ef-c056-4254-8370-32fabc75bf6d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:23.213670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-cd7354ef-c056-4254-8370-32fabc75bf6d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:23.219585 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd7354ef-c056-4254-8370-32fabc75bf6d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:23.220076 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd7354ef-c056-4254-8370-32fabc75bf6d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:23.220830 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd7354ef-c056-4254-8370-32fabc75bf6d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:23.221263 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd7354ef-c056-4254-8370-32fabc75bf6d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:23.345617 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-cd7354ef-c056-4254-8370-32fabc75bf6d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:23.353396 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-cd7354ef-c056-4254-8370-32fabc75bf6d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.144528 May 09 04:27:23.353963 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 103/188] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:23 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:23.486350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-790a6ffb-59bc-4360-8049-2012bd04da28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:23.486964 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-790a6ffb-59bc-4360-8049-2012bd04da28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:23.492993 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-790a6ffb-59bc-4360-8049-2012bd04da28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:23.493436 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-790a6ffb-59bc-4360-8049-2012bd04da28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:23.494191 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-790a6ffb-59bc-4360-8049-2012bd04da28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:23.494623 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-790a6ffb-59bc-4360-8049-2012bd04da28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:23.618422 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-790a6ffb-59bc-4360-8049-2012bd04da28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:23.626113 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-790a6ffb-59bc-4360-8049-2012bd04da28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:23.627617 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-790a6ffb-59bc-4360-8049-2012bd04da28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:23.628740 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-790a6ffb-59bc-4360-8049-2012bd04da28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1407 microversion: 2.20 time: 0.146242 May 09 04:27:23.629375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 86/189] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:23 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:24.122659 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-410c4acb-5147-4dd0-82b2-23600140f3b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:24.123281 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-410c4acb-5147-4dd0-82b2-23600140f3b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:24.129675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-410c4acb-5147-4dd0-82b2-23600140f3b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:24.130120 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-410c4acb-5147-4dd0-82b2-23600140f3b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:24.131044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-410c4acb-5147-4dd0-82b2-23600140f3b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:24.132265 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-410c4acb-5147-4dd0-82b2-23600140f3b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:24.271607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-410c4acb-5147-4dd0-82b2-23600140f3b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:24.279293 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-410c4acb-5147-4dd0-82b2-23600140f3b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.160493 May 09 04:27:24.279868 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 104/190] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:24 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:24.370489 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c9a6dc14-1afb-4d0a-b586-f40f33b1ad1e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:24.371059 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c9a6dc14-1afb-4d0a-b586-f40f33b1ad1e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:24.376959 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c9a6dc14-1afb-4d0a-b586-f40f33b1ad1e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:24.377401 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c9a6dc14-1afb-4d0a-b586-f40f33b1ad1e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:24.378152 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c9a6dc14-1afb-4d0a-b586-f40f33b1ad1e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:24.378578 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c9a6dc14-1afb-4d0a-b586-f40f33b1ad1e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:24.522737 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c9a6dc14-1afb-4d0a-b586-f40f33b1ad1e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:24.530269 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c9a6dc14-1afb-4d0a-b586-f40f33b1ad1e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.163665 May 09 04:27:24.530826 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 87/191] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:24 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:24.646479 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-992ffdfa-ecbe-4176-9945-e44dd746177a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:24.647113 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-992ffdfa-ecbe-4176-9945-e44dd746177a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:24.653767 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-992ffdfa-ecbe-4176-9945-e44dd746177a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:24.654436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-992ffdfa-ecbe-4176-9945-e44dd746177a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:24.657131 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-992ffdfa-ecbe-4176-9945-e44dd746177a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:24.657733 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-992ffdfa-ecbe-4176-9945-e44dd746177a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:24.885629 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-992ffdfa-ecbe-4176-9945-e44dd746177a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:24.893693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-992ffdfa-ecbe-4176-9945-e44dd746177a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:24.896691 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bd043ab7-49f5-4742-842b-f7620a897787 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ac94cc4-ba64-4411-be4e-11595f0b2bf9"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:27:24.897480 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-992ffdfa-ecbe-4176-9945-e44dd746177a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:24.899194 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-992ffdfa-ecbe-4176-9945-e44dd746177a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1599 microversion: 2.20 time: 0.256431 May 09 04:27:24.899463 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-bd043ab7-49f5-4742-842b-f7620a897787 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:24.903946 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 105/192] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:27:24 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1599 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:27:24.906163 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bd043ab7-49f5-4742-842b-f7620a897787 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:24.906750 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bd043ab7-49f5-4742-842b-f7620a897787 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:24.907658 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bd043ab7-49f5-4742-842b-f7620a897787 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:24.908243 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bd043ab7-49f5-4742-842b-f7620a897787 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:24.918427 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1a08c662-a6b1-412f-9854-27efd662eafb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:24.919095 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1a08c662-a6b1-412f-9854-27efd662eafb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:24.929520 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a08c662-a6b1-412f-9854-27efd662eafb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:24.929970 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a08c662-a6b1-412f-9854-27efd662eafb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:24.930740 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a08c662-a6b1-412f-9854-27efd662eafb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:24.931172 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a08c662-a6b1-412f-9854-27efd662eafb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:25.058711 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1a08c662-a6b1-412f-9854-27efd662eafb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.144085 May 09 04:27:25.060284 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 106/193] 10.222.0.44 () {60 vars in 1315 bytes} [Mon May 9 04:27:24 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:27:25.295609 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f0bfc6a1-801e-4391-81a2-3ae4644b4f28 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:25.296910 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f0bfc6a1-801e-4391-81a2-3ae4644b4f28 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:25.308022 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f0bfc6a1-801e-4391-81a2-3ae4644b4f28 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:25.308235 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f0bfc6a1-801e-4391-81a2-3ae4644b4f28 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:25.309093 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f0bfc6a1-801e-4391-81a2-3ae4644b4f28 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:25.309698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f0bfc6a1-801e-4391-81a2-3ae4644b4f28 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:25.550800 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f0bfc6a1-801e-4391-81a2-3ae4644b4f28 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:25.559941 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f0bfc6a1-801e-4391-81a2-3ae4644b4f28 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.268137 May 09 04:27:25.560525 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 107/194] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:25 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:27:25.565255 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-15f826b3-739e-4a71-82db-29918d04a9c6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:25.566050 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-15f826b3-739e-4a71-82db-29918d04a9c6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:25.572914 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-15f826b3-739e-4a71-82db-29918d04a9c6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:25.573438 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-15f826b3-739e-4a71-82db-29918d04a9c6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:25.574446 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-15f826b3-739e-4a71-82db-29918d04a9c6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:25.575044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-15f826b3-739e-4a71-82db-29918d04a9c6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:25.917614 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-15f826b3-739e-4a71-82db-29918d04a9c6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:25.928279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-15f826b3-739e-4a71-82db-29918d04a9c6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1362 microversion: 2.1 time: 0.365637 May 09 04:27:25.929469 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 108/195] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:25 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:26.117125 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-80399feb-28f5-466c-8632-279d215fbe25 req-3050d726-b360-4565-9df8-f3bad72c83de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc9d45a-d1d9-4a28-8af9-4b6e14898436", "name": "network-vif-plugged", "status": "completed", "tag": "e798f1fa-3df7-4ec0-be2e-bf5db59b8036"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:27:26.151787 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-80399feb-28f5-466c-8632-279d215fbe25 req-3050d726-b360-4565-9df8-f3bad72c83de service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:26.151787 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-80399feb-28f5-466c-8632-279d215fbe25 req-3050d726-b360-4565-9df8-f3bad72c83de service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:26.189208 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-80399feb-28f5-466c-8632-279d215fbe25 req-3050d726-b360-4565-9df8-f3bad72c83de service nova] Creating event network-vif-plugged:e798f1fa-3df7-4ec0-be2e-bf5db59b8036 for instance 7fc9d45a-d1d9-4a28-8af9-4b6e14898436 on hv-cinder-83800 May 09 04:27:26.220307 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-80399feb-28f5-466c-8632-279d215fbe25 req-3050d726-b360-4565-9df8-f3bad72c83de service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109510 May 09 04:27:26.221160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 109/196] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:27:26.401456 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bd043ab7-49f5-4742-842b-f7620a897787 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "POST /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.508431 May 09 04:27:26.402090 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 88/197] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 04:27:24 2022] POST /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d/os-volume_attachments => generated 194 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:27:26.579697 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b7648dab-8c71-48ba-a040-35cc87e37e3f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:26.581227 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b7648dab-8c71-48ba-a040-35cc87e37e3f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:26.589796 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b7648dab-8c71-48ba-a040-35cc87e37e3f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:26.590515 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b7648dab-8c71-48ba-a040-35cc87e37e3f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:26.591547 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b7648dab-8c71-48ba-a040-35cc87e37e3f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:26.592219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b7648dab-8c71-48ba-a040-35cc87e37e3f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:26.910127 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b7648dab-8c71-48ba-a040-35cc87e37e3f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:26.921421 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b7648dab-8c71-48ba-a040-35cc87e37e3f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.346931 May 09 04:27:26.922201 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 110/198] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:26 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:26.946689 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c5b7c544-6698-4ec9-9527-9b63850e7f08 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:26.948158 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c5b7c544-6698-4ec9-9527-9b63850e7f08 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:26.961450 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5b7c544-6698-4ec9-9527-9b63850e7f08 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:26.962157 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5b7c544-6698-4ec9-9527-9b63850e7f08 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:26.963753 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5b7c544-6698-4ec9-9527-9b63850e7f08 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:26.965058 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5b7c544-6698-4ec9-9527-9b63850e7f08 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:27.038741 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-013080b1-e54c-4c42-800c-8f2c5037f035 req-aab70406-c0e1-41fa-8027-84a637eadb1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d10350c6-bf15-414f-9bf7-d371b6912be2", "tag": "2abd51b8-3b37-4ec3-841e-462a68eb5cbc"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:27:27.048385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-013080b1-e54c-4c42-800c-8f2c5037f035 req-aab70406-c0e1-41fa-8027-84a637eadb1a service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:27.049054 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-013080b1-e54c-4c42-800c-8f2c5037f035 req-aab70406-c0e1-41fa-8027-84a637eadb1a service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:27.061226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-013080b1-e54c-4c42-800c-8f2c5037f035 req-aab70406-c0e1-41fa-8027-84a637eadb1a service nova] Creating event network-changed:2abd51b8-3b37-4ec3-841e-462a68eb5cbc for instance d10350c6-bf15-414f-9bf7-d371b6912be2 on hv-cinder-83800 May 09 04:27:27.072108 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-013080b1-e54c-4c42-800c-8f2c5037f035 req-aab70406-c0e1-41fa-8027-84a637eadb1a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037995 May 09 04:27:27.073263 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 111/199] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:27:27.136133 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c5b7c544-6698-4ec9-9527-9b63850e7f08 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:27.149327 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c5b7c544-6698-4ec9-9527-9b63850e7f08 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1549 microversion: 2.1 time: 0.207115 May 09 04:27:27.150037 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 89/200] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:26 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1549 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:27.168000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-62afb26d-ef6b-40f4-b965-044bbf856bf8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:27.168668 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-62afb26d-ef6b-40f4-b965-044bbf856bf8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:27.175514 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-62afb26d-ef6b-40f4-b965-044bbf856bf8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:27.176256 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-62afb26d-ef6b-40f4-b965-044bbf856bf8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:27.178482 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-62afb26d-ef6b-40f4-b965-044bbf856bf8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:27.179076 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-62afb26d-ef6b-40f4-b965-044bbf856bf8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:27.279804 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-62afb26d-ef6b-40f4-b965-044bbf856bf8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115794 May 09 04:27:27.280773 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 112/201] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 04:27:27 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:27:27.939540 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0cf6fb19-df93-4714-8c71-8cb7b5f2413f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:27.940181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0cf6fb19-df93-4714-8c71-8cb7b5f2413f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:27.953696 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0cf6fb19-df93-4714-8c71-8cb7b5f2413f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:27.954069 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0cf6fb19-df93-4714-8c71-8cb7b5f2413f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:27.965253 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0cf6fb19-df93-4714-8c71-8cb7b5f2413f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:27.967289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0cf6fb19-df93-4714-8c71-8cb7b5f2413f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:28.400025 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0cf6fb19-df93-4714-8c71-8cb7b5f2413f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:28.412424 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0cf6fb19-df93-4714-8c71-8cb7b5f2413f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.477072 May 09 04:27:28.414313 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 90/202] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:27 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:29.245944 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-dd195515-98da-4c4e-b5cd-9cca008235b9 req-11f6cf42-5b8a-4869-91da-fe1eb765a68d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2923fc2-3ae0-4f89-b36c-193752581504", "tag": "7cfb4f53-5fec-4952-ba0d-117da0e35d2d"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:27:29.256597 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-dd195515-98da-4c4e-b5cd-9cca008235b9 req-11f6cf42-5b8a-4869-91da-fe1eb765a68d service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:29.257358 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-dd195515-98da-4c4e-b5cd-9cca008235b9 req-11f6cf42-5b8a-4869-91da-fe1eb765a68d service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:29.272640 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-dd195515-98da-4c4e-b5cd-9cca008235b9 req-11f6cf42-5b8a-4869-91da-fe1eb765a68d service nova] Creating event network-changed:7cfb4f53-5fec-4952-ba0d-117da0e35d2d for instance f2923fc2-3ae0-4f89-b36c-193752581504 on hv-cinder-83800 May 09 04:27:29.279254 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-dd195515-98da-4c4e-b5cd-9cca008235b9 req-11f6cf42-5b8a-4869-91da-fe1eb765a68d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037121 May 09 04:27:29.280406 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 113/203] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:27:29.437794 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a6bd835d-c187-4fd4-9bdd-9a9fda742852 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:29.439047 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a6bd835d-c187-4fd4-9bdd-9a9fda742852 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:29.454527 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a6bd835d-c187-4fd4-9bdd-9a9fda742852 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:29.456990 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a6bd835d-c187-4fd4-9bdd-9a9fda742852 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:29.457756 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a6bd835d-c187-4fd4-9bdd-9a9fda742852 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:29.461420 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a6bd835d-c187-4fd4-9bdd-9a9fda742852 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:29.911549 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a6bd835d-c187-4fd4-9bdd-9a9fda742852 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:29.919617 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a6bd835d-c187-4fd4-9bdd-9a9fda742852 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1321 microversion: 2.1 time: 0.488274 May 09 04:27:29.923618 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 91/204] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:29 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:30.940448 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b5293cbd-0b15-44e1-8e38-a78d718f2ff4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:30.941810 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b5293cbd-0b15-44e1-8e38-a78d718f2ff4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:30.950589 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b5293cbd-0b15-44e1-8e38-a78d718f2ff4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:30.951313 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b5293cbd-0b15-44e1-8e38-a78d718f2ff4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:30.952337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b5293cbd-0b15-44e1-8e38-a78d718f2ff4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:30.952974 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b5293cbd-0b15-44e1-8e38-a78d718f2ff4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:31.138201 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b5293cbd-0b15-44e1-8e38-a78d718f2ff4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:31.146097 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b5293cbd-0b15-44e1-8e38-a78d718f2ff4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1515 microversion: 2.1 time: 0.209961 May 09 04:27:31.148121 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 114/205] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:30 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:31.165693 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ebf854f4-10a7-48f7-868d-072a20d79934 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:27:31.167562 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ebf854f4-10a7-48f7-868d-072a20d79934 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:31.176084 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebf854f4-10a7-48f7-868d-072a20d79934 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:31.176805 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebf854f4-10a7-48f7-868d-072a20d79934 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:31.179420 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebf854f4-10a7-48f7-868d-072a20d79934 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:31.180194 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebf854f4-10a7-48f7-868d-072a20d79934 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:31.223281 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-ebf854f4-10a7-48f7-868d-072a20d79934 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lazy-loading 'flavor' on Instance uuid 7fc9d45a-d1d9-4a28-8af9-4b6e14898436 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:27:31.413004 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ebf854f4-10a7-48f7-868d-072a20d79934 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "POST /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436/action" status: 200 len: 32 microversion: 2.1 time: 0.252115 May 09 04:27:31.414026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 92/206] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 04:27:31 2022] POST /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 04:27:31.423057 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e7f9f153-9e1a-4637-96e6-6705a458453a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:31.423667 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e7f9f153-9e1a-4637-96e6-6705a458453a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:31.438176 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e7f9f153-9e1a-4637-96e6-6705a458453a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:31.438633 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e7f9f153-9e1a-4637-96e6-6705a458453a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:31.439414 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e7f9f153-9e1a-4637-96e6-6705a458453a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:31.439849 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e7f9f153-9e1a-4637-96e6-6705a458453a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:31.717719 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e7f9f153-9e1a-4637-96e6-6705a458453a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:31.730118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e7f9f153-9e1a-4637-96e6-6705a458453a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.311345 May 09 04:27:31.735480 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 115/207] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:31 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:32.753727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-53fa6bcb-5b55-4895-968d-50f19a56a267 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:32.754520 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-53fa6bcb-5b55-4895-968d-50f19a56a267 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:32.761676 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-53fa6bcb-5b55-4895-968d-50f19a56a267 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:32.761676 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-53fa6bcb-5b55-4895-968d-50f19a56a267 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:32.762424 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-53fa6bcb-5b55-4895-968d-50f19a56a267 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:32.762853 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-53fa6bcb-5b55-4895-968d-50f19a56a267 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:32.987821 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-53fa6bcb-5b55-4895-968d-50f19a56a267 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:32.996532 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-53fa6bcb-5b55-4895-968d-50f19a56a267 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.247377 May 09 04:27:32.997062 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 93/208] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:32 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:34.014108 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-bb6e8a3a-7412-418f-878d-34250b84f8c6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:34.029383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-bb6e8a3a-7412-418f-878d-34250b84f8c6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:34.031182 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bb6e8a3a-7412-418f-878d-34250b84f8c6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:34.031625 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bb6e8a3a-7412-418f-878d-34250b84f8c6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:34.032436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bb6e8a3a-7412-418f-878d-34250b84f8c6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:34.032861 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bb6e8a3a-7412-418f-878d-34250b84f8c6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:34.189331 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-bb6e8a3a-7412-418f-878d-34250b84f8c6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:34.197724 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-bb6e8a3a-7412-418f-878d-34250b84f8c6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.187482 May 09 04:27:34.204313 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 116/209] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:34 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:35.215533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4d0b7acf-a899-4f89-90ae-c3be71b28950 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:35.216753 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4d0b7acf-a899-4f89-90ae-c3be71b28950 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:35.223166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d0b7acf-a899-4f89-90ae-c3be71b28950 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:35.223602 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d0b7acf-a899-4f89-90ae-c3be71b28950 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:35.224583 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d0b7acf-a899-4f89-90ae-c3be71b28950 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:35.225232 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d0b7acf-a899-4f89-90ae-c3be71b28950 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:35.358626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4d0b7acf-a899-4f89-90ae-c3be71b28950 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:35.369619 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4d0b7acf-a899-4f89-90ae-c3be71b28950 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.158026 May 09 04:27:35.375877 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 94/210] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:35 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:36.387441 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6801bafa-8828-4866-a8f5-c05eecd96e94 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:36.388184 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6801bafa-8828-4866-a8f5-c05eecd96e94 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:36.395071 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6801bafa-8828-4866-a8f5-c05eecd96e94 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:36.395518 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6801bafa-8828-4866-a8f5-c05eecd96e94 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:36.396310 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6801bafa-8828-4866-a8f5-c05eecd96e94 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:36.396772 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6801bafa-8828-4866-a8f5-c05eecd96e94 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:36.597258 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-6801bafa-8828-4866-a8f5-c05eecd96e94 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:36.605717 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6801bafa-8828-4866-a8f5-c05eecd96e94 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.222236 May 09 04:27:36.606286 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 117/211] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:36 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:37.624942 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ee6b2d6a-e750-4c38-bb66-368a7db39176 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:37.626356 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ee6b2d6a-e750-4c38-bb66-368a7db39176 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:37.637072 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee6b2d6a-e750-4c38-bb66-368a7db39176 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:37.639792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee6b2d6a-e750-4c38-bb66-368a7db39176 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:37.642177 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee6b2d6a-e750-4c38-bb66-368a7db39176 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:37.644269 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee6b2d6a-e750-4c38-bb66-368a7db39176 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:37.887745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ee6b2d6a-e750-4c38-bb66-368a7db39176 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:37.897285 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ee6b2d6a-e750-4c38-bb66-368a7db39176 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.276829 May 09 04:27:37.898810 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 95/212] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:37 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:38.393296 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a6a606ef-b339-437f-b27e-e920e1580061 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:38.393811 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a6a606ef-b339-437f-b27e-e920e1580061 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:38.404347 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6a606ef-b339-437f-b27e-e920e1580061 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:38.404902 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6a606ef-b339-437f-b27e-e920e1580061 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:38.405757 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6a606ef-b339-437f-b27e-e920e1580061 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:38.406302 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6a606ef-b339-437f-b27e-e920e1580061 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:38.437884 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a6a606ef-b339-437f-b27e-e920e1580061 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Going to try to terminate instance {{(pid=117033) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:27:38.604285 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a6a606ef-b339-437f-b27e-e920e1580061 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "DELETE /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 204 len: 0 microversion: 2.1 time: 0.214379 May 09 04:27:38.605894 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 118/213] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:27:38 2022] DELETE /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:27:38.618508 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-009b1e85-824e-409e-83c0-39ba0c06007e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:38.619322 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-009b1e85-824e-409e-83c0-39ba0c06007e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:38.627422 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-009b1e85-824e-409e-83c0-39ba0c06007e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:38.628960 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-009b1e85-824e-409e-83c0-39ba0c06007e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:38.629918 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-009b1e85-824e-409e-83c0-39ba0c06007e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:38.631449 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-009b1e85-824e-409e-83c0-39ba0c06007e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:38.832776 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-009b1e85-824e-409e-83c0-39ba0c06007e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:38.844316 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-009b1e85-824e-409e-83c0-39ba0c06007e tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1553 microversion: 2.1 time: 0.233956 May 09 04:27:38.853933 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 96/214] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:38 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1553 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:38.918675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6dbf2634-b043-4564-ba00-c07711014d76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:38.919660 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6dbf2634-b043-4564-ba00-c07711014d76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:38.926277 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6dbf2634-b043-4564-ba00-c07711014d76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:38.926728 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6dbf2634-b043-4564-ba00-c07711014d76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:38.927661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6dbf2634-b043-4564-ba00-c07711014d76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:38.928097 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6dbf2634-b043-4564-ba00-c07711014d76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:39.152765 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-6dbf2634-b043-4564-ba00-c07711014d76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:39.161481 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6dbf2634-b043-4564-ba00-c07711014d76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.250600 May 09 04:27:39.172441 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 119/215] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:38 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:39.862118 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-eae9eb81-3b7b-4dd6-a9e7-7d7126aa5f24 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:39.862911 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-eae9eb81-3b7b-4dd6-a9e7-7d7126aa5f24 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:39.870452 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eae9eb81-3b7b-4dd6-a9e7-7d7126aa5f24 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:39.871115 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eae9eb81-3b7b-4dd6-a9e7-7d7126aa5f24 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:39.872179 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eae9eb81-3b7b-4dd6-a9e7-7d7126aa5f24 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:39.872996 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eae9eb81-3b7b-4dd6-a9e7-7d7126aa5f24 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:40.060580 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-eae9eb81-3b7b-4dd6-a9e7-7d7126aa5f24 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:40.070767 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-eae9eb81-3b7b-4dd6-a9e7-7d7126aa5f24 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1553 microversion: 2.1 time: 0.213054 May 09 04:27:40.071365 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 97/216] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:39 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:40.196239 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-acea9fd4-a085-48df-8dfc-f1a35bf80a00 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:40.196986 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-acea9fd4-a085-48df-8dfc-f1a35bf80a00 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:40.204837 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-acea9fd4-a085-48df-8dfc-f1a35bf80a00 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:40.205290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-acea9fd4-a085-48df-8dfc-f1a35bf80a00 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:40.206072 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-acea9fd4-a085-48df-8dfc-f1a35bf80a00 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:40.206555 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-acea9fd4-a085-48df-8dfc-f1a35bf80a00 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:40.832791 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-acea9fd4-a085-48df-8dfc-f1a35bf80a00 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:40.840569 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-acea9fd4-a085-48df-8dfc-f1a35bf80a00 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.664868 May 09 04:27:40.841164 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 120/217] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:40 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:27:41.088466 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3ed35233-5f7e-41fa-b9ed-3f3fc194257a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:41.089654 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3ed35233-5f7e-41fa-b9ed-3f3fc194257a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:41.100766 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3ed35233-5f7e-41fa-b9ed-3f3fc194257a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:41.101228 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3ed35233-5f7e-41fa-b9ed-3f3fc194257a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:41.102016 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3ed35233-5f7e-41fa-b9ed-3f3fc194257a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:41.102453 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3ed35233-5f7e-41fa-b9ed-3f3fc194257a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:41.307988 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3ed35233-5f7e-41fa-b9ed-3f3fc194257a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:41.325927 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3ed35233-5f7e-41fa-b9ed-3f3fc194257a tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1553 microversion: 2.1 time: 0.238774 May 09 04:27:41.328115 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 98/218] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:41 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1553 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:41.858127 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-fcabb900-1138-4c94-afa2-367be3d32c95 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:41.858766 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-fcabb900-1138-4c94-afa2-367be3d32c95 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:41.869620 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fcabb900-1138-4c94-afa2-367be3d32c95 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:41.874582 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fcabb900-1138-4c94-afa2-367be3d32c95 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:41.875623 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fcabb900-1138-4c94-afa2-367be3d32c95 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:41.876667 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fcabb900-1138-4c94-afa2-367be3d32c95 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:42.267541 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-a47ba433-e833-4ba7-a133-4d2043918dc0 req-fbbd3fff-4adf-4a5e-840d-3c50cce7bab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e2388e-186d-4ea8-94d7-5b9952abc60d", "name": "network-vif-deleted", "tag": "7113abb1-73d9-40ca-bca3-339dc9e98ae7"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:27:42.317730 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-a47ba433-e833-4ba7-a133-4d2043918dc0 req-fbbd3fff-4adf-4a5e-840d-3c50cce7bab3 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:42.318387 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-a47ba433-e833-4ba7-a133-4d2043918dc0 req-fbbd3fff-4adf-4a5e-840d-3c50cce7bab3 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:42.645380 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-a47ba433-e833-4ba7-a133-4d2043918dc0 req-fbbd3fff-4adf-4a5e-840d-3c50cce7bab3 service nova] Creating event network-vif-deleted:7113abb1-73d9-40ca-bca3-339dc9e98ae7 for instance 06e2388e-186d-4ea8-94d7-5b9952abc60d on hv-cinder-83800 May 09 04:27:42.653211 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-a47ba433-e833-4ba7-a133-4d2043918dc0 req-fbbd3fff-4adf-4a5e-840d-3c50cce7bab3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.390130 May 09 04:27:42.654087 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 99/219] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:27:42.661230 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-203cf9cb-2fae-438d-b1a6-497e9f62cf56 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:42.663590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-203cf9cb-2fae-438d-b1a6-497e9f62cf56 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:42.679062 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-fcabb900-1138-4c94-afa2-367be3d32c95 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:42.683068 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-203cf9cb-2fae-438d-b1a6-497e9f62cf56 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:42.687929 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-203cf9cb-2fae-438d-b1a6-497e9f62cf56 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:42.689217 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-fcabb900-1138-4c94-afa2-367be3d32c95 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.835142 May 09 04:27:42.690354 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-203cf9cb-2fae-438d-b1a6-497e9f62cf56 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:42.691251 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 121/220] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:41 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:42.691732 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-203cf9cb-2fae-438d-b1a6-497e9f62cf56 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:42.829076 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-203cf9cb-2fae-438d-b1a6-497e9f62cf56 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9461afbc4a9545f087184cb5e8465512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935900d28d414052836bae2238354dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:42.843649 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-203cf9cb-2fae-438d-b1a6-497e9f62cf56 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 200 len: 1345 microversion: 2.1 time: 0.186061 May 09 04:27:42.845032 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 100/221] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:42 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 1345 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:43.714496 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a3e6a67e-f999-49f9-8181-7a907abb8eff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:43.715300 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a3e6a67e-f999-49f9-8181-7a907abb8eff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:43.736984 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a3e6a67e-f999-49f9-8181-7a907abb8eff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:43.738182 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a3e6a67e-f999-49f9-8181-7a907abb8eff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:43.748406 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a3e6a67e-f999-49f9-8181-7a907abb8eff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:43.749810 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a3e6a67e-f999-49f9-8181-7a907abb8eff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:43.863797 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c5023a0a-da26-4d56-b164-f0bf95a2867f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:43.864748 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c5023a0a-da26-4d56-b164-f0bf95a2867f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:43.893024 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5023a0a-da26-4d56-b164-f0bf95a2867f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:43.895222 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5023a0a-da26-4d56-b164-f0bf95a2867f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:43.897581 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5023a0a-da26-4d56-b164-f0bf95a2867f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:43.901248 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5023a0a-da26-4d56-b164-f0bf95a2867f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:43.955944 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-c5023a0a-da26-4d56-b164-f0bf95a2867f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] HTTP exception thrown: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c5023a0a-da26-4d56-b164-f0bf95a2867f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Request method failure captured: May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d HTTP/1.1 May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJflDJwzv_vGNfcnCOoPjoCHX4u2RmvDwu0Vy4SM696eMl0gl-gpuFNrIHvHjSeh66DRjbLRx81dzdj4lmPXhfbwwTQLsT_YN0r3jxUkqckl755ckqbHjdTlWAgnjlkmDIC3x7czgAxs0NLKZntalX2iD8SO-l9AYlFR2uejXdyBe4Q May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 935900d28d414052836bae2238354dcc May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-DeleteServersTestJSON-156451404 May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:27:43.978000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:27:43.979181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/935900d28d414052836bae2238354dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/935900d28d414052836bae2238354dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/935900d28d414052836bae2238354dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_935900d28d414052836bae2238354dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:27:43.979181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-DeleteServersTestJSON-156451404 May 09 04:27:43.979181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 935900d28d414052836bae2238354dcc May 09 04:27:43.979181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-DeleteServersTestJSON-156451404 May 09 04:27:43.979181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-DeleteServersTestJSON-156451404-project May 09 04:27:43.979181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:27:43.979181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:27:43.979181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 9461afbc4a9545f087184cb5e8465512 May 09 04:27:43.979181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-DeleteServersTestJSON-156451404-project May 09 04:27:43.979181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:27:43.979181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:43.979181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '06e2388e-186d-4ea8-94d7-5b9952abc60d'} May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:27:43.980344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:43.981590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:43.982593 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c5023a0a-da26-4d56-b164-f0bf95a2867f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Returning 404 to user: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:27:43.985121 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c5023a0a-da26-4d56-b164-f0bf95a2867f tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 404 len: 111 microversion: 2.1 time: 0.125668 May 09 04:27:43.985788 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 101/222] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:43 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 04:27:44.206098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b9babae1-6792-4053-82b3-991008b837fb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:44.207383 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b9babae1-6792-4053-82b3-991008b837fb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:44.218243 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b9babae1-6792-4053-82b3-991008b837fb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:44.220890 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b9babae1-6792-4053-82b3-991008b837fb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:44.221879 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b9babae1-6792-4053-82b3-991008b837fb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:44.225173 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b9babae1-6792-4053-82b3-991008b837fb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:44.269964 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-b9babae1-6792-4053-82b3-991008b837fb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] HTTP exception thrown: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b9babae1-6792-4053-82b3-991008b837fb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Request method failure captured: May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d/os-volume_attachments HTTP/1.1 May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJflDJwzv_vGNfcnCOoPjoCHX4u2RmvDwu0Vy4SM696eMl0gl-gpuFNrIHvHjSeh66DRjbLRx81dzdj4lmPXhfbwwTQLsT_YN0r3jxUkqckl755ckqbHjdTlWAgnjlkmDIC3x7czgAxs0NLKZntalX2iD8SO-l9AYlFR2uejXdyBe4Q May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 935900d28d414052836bae2238354dcc May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-DeleteServersTestJSON-156451404 May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:27:44.291721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:27:44.293000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/935900d28d414052836bae2238354dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/935900d28d414052836bae2238354dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/935900d28d414052836bae2238354dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_935900d28d414052836bae2238354dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:27:44.293000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-DeleteServersTestJSON-156451404 May 09 04:27:44.293000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 935900d28d414052836bae2238354dcc May 09 04:27:44.293000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-DeleteServersTestJSON-156451404 May 09 04:27:44.293000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-DeleteServersTestJSON-156451404-project May 09 04:27:44.293000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:27:44.293000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:27:44.293000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 9461afbc4a9545f087184cb5e8465512 May 09 04:27:44.293000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-DeleteServersTestJSON-156451404-project May 09 04:27:44.293000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:27:44.293000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:44.293000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'server_id': '06e2388e-186d-4ea8-94d7-5b9952abc60d'} May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:27:44.293745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:44.294825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:44.296057 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b9babae1-6792-4053-82b3-991008b837fb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Returning 404 to user: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:27:44.296057 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b9babae1-6792-4053-82b3-991008b837fb tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.091993 May 09 04:27:44.296057 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 102/223] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:27:44 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d/os-volume_attachments => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:27:44.945865 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a3e6a67e-f999-49f9-8181-7a907abb8eff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:44.954233 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a3e6a67e-f999-49f9-8181-7a907abb8eff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 1.249633 May 09 04:27:44.958333 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 122/224] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:43 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:45.648727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cf96f860-a2db-4d1e-9e23-ffd7673e0f22 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:45.649343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-cf96f860-a2db-4d1e-9e23-ffd7673e0f22 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:45.661342 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf96f860-a2db-4d1e-9e23-ffd7673e0f22 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:45.661961 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf96f860-a2db-4d1e-9e23-ffd7673e0f22 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:45.664263 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf96f860-a2db-4d1e-9e23-ffd7673e0f22 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:45.665237 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf96f860-a2db-4d1e-9e23-ffd7673e0f22 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:45.706545 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-cf96f860-a2db-4d1e-9e23-ffd7673e0f22 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] HTTP exception thrown: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cf96f860-a2db-4d1e-9e23-ffd7673e0f22 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Request method failure captured: May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: DELETE /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d HTTP/1.1 May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJflDJwzv_vGNfcnCOoPjoCHX4u2RmvDwu0Vy4SM696eMl0gl-gpuFNrIHvHjSeh66DRjbLRx81dzdj4lmPXhfbwwTQLsT_YN0r3jxUkqckl755ckqbHjdTlWAgnjlkmDIC3x7czgAxs0NLKZntalX2iD8SO-l9AYlFR2uejXdyBe4Q May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 935900d28d414052836bae2238354dcc May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-DeleteServersTestJSON-156451404 May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:27:45.710616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:27:45.712405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/935900d28d414052836bae2238354dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/935900d28d414052836bae2238354dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/935900d28d414052836bae2238354dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_935900d28d414052836bae2238354dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:27:45.712405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-DeleteServersTestJSON-156451404 May 09 04:27:45.712405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 935900d28d414052836bae2238354dcc May 09 04:27:45.712405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-DeleteServersTestJSON-156451404 May 09 04:27:45.712405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-DeleteServersTestJSON-156451404-project May 09 04:27:45.712405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:27:45.712405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:27:45.712405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 9461afbc4a9545f087184cb5e8465512 May 09 04:27:45.712405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-DeleteServersTestJSON-156451404-project May 09 04:27:45.712405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:27:45.712405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:45.712405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '06e2388e-186d-4ea8-94d7-5b9952abc60d'} May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:27:45.713212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:45.714616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:27:45.720514 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cf96f860-a2db-4d1e-9e23-ffd7673e0f22 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Returning 404 to user: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:27:45.722834 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-cf96f860-a2db-4d1e-9e23-ffd7673e0f22 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "DELETE /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 404 len: 111 microversion: 2.1 time: 0.078695 May 09 04:27:45.724020 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 103/225] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:27:45 2022] DELETE /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:27:45.732370 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-31272d5b-6e67-483c-8061-d27a31386408 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:45.733100 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-31272d5b-6e67-483c-8061-d27a31386408 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] [instance: 06e2388e-186d-4ea8-94d7-5b9952abc60d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:45.740959 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-31272d5b-6e67-483c-8061-d27a31386408 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:45.744048 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-31272d5b-6e67-483c-8061-d27a31386408 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:45.758772 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-31272d5b-6e67-483c-8061-d27a31386408 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:45.762387 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-31272d5b-6e67-483c-8061-d27a31386408 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:45.787303 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-31272d5b-6e67-483c-8061-d27a31386408 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] HTTP exception thrown: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-31272d5b-6e67-483c-8061-d27a31386408 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Request method failure captured: May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d HTTP/1.1 May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJflDJwzv_vGNfcnCOoPjoCHX4u2RmvDwu0Vy4SM696eMl0gl-gpuFNrIHvHjSeh66DRjbLRx81dzdj4lmPXhfbwwTQLsT_YN0r3jxUkqckl755ckqbHjdTlWAgnjlkmDIC3x7czgAxs0NLKZntalX2iD8SO-l9AYlFR2uejXdyBe4Q May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 935900d28d414052836bae2238354dcc May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-DeleteServersTestJSON-156451404 May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:27:45.823491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:27:45.824742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/935900d28d414052836bae2238354dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/935900d28d414052836bae2238354dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/935900d28d414052836bae2238354dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_935900d28d414052836bae2238354dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:27:45.824742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-DeleteServersTestJSON-156451404 May 09 04:27:45.824742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 935900d28d414052836bae2238354dcc May 09 04:27:45.824742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-DeleteServersTestJSON-156451404 May 09 04:27:45.824742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-DeleteServersTestJSON-156451404-project May 09 04:27:45.824742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:27:45.824742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:27:45.824742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 9461afbc4a9545f087184cb5e8465512 May 09 04:27:45.824742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-DeleteServersTestJSON-156451404-project May 09 04:27:45.824742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:27:45.824742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:45.824742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': '06e2388e-186d-4ea8-94d7-5b9952abc60d'} May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:27:45.825383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. May 09 04:27:45.826436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:27:45.836353 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-31272d5b-6e67-483c-8061-d27a31386408 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] Returning 404 to user: Instance 06e2388e-186d-4ea8-94d7-5b9952abc60d could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:27:45.837647 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-31272d5b-6e67-483c-8061-d27a31386408 tempest-DeleteServersTestJSON-156451404 tempest-DeleteServersTestJSON-156451404-project] 10.222.0.44 "GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d" status: 404 len: 111 microversion: 2.1 time: 0.109669 May 09 04:27:45.840126 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 123/226] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:45 2022] GET /compute/v2.1/servers/06e2388e-186d-4ea8-94d7-5b9952abc60d => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:27:45.975506 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-778c837e-546e-49d1-be62-ced952670bfc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:45.976374 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-778c837e-546e-49d1-be62-ced952670bfc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:46.002284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-778c837e-546e-49d1-be62-ced952670bfc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:46.002993 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-778c837e-546e-49d1-be62-ced952670bfc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:46.005844 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-778c837e-546e-49d1-be62-ced952670bfc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:46.011356 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-778c837e-546e-49d1-be62-ced952670bfc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:46.774507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-778c837e-546e-49d1-be62-ced952670bfc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:46.820542 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-778c837e-546e-49d1-be62-ced952670bfc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.849647 May 09 04:27:46.821162 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 104/227] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:45 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:47.839147 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8ebcaa88-a639-4c38-b0f5-c4c9e57c29c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:47.840797 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8ebcaa88-a639-4c38-b0f5-c4c9e57c29c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:47.853587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8ebcaa88-a639-4c38-b0f5-c4c9e57c29c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:47.855980 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8ebcaa88-a639-4c38-b0f5-c4c9e57c29c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:47.857633 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8ebcaa88-a639-4c38-b0f5-c4c9e57c29c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:47.863826 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8ebcaa88-a639-4c38-b0f5-c4c9e57c29c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:48.693674 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8ebcaa88-a639-4c38-b0f5-c4c9e57c29c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:48.703928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8ebcaa88-a639-4c38-b0f5-c4c9e57c29c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.869855 May 09 04:27:48.727155 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 124/228] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:47 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:49.722476 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b043c4b9-c53b-45eb-940d-5c775f9cec23 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:49.723185 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b043c4b9-c53b-45eb-940d-5c775f9cec23 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:49.735857 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b043c4b9-c53b-45eb-940d-5c775f9cec23 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:49.736237 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b043c4b9-c53b-45eb-940d-5c775f9cec23 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:49.737026 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b043c4b9-c53b-45eb-940d-5c775f9cec23 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:49.737463 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b043c4b9-c53b-45eb-940d-5c775f9cec23 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:50.105902 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f88b8b0d-6f96-4685-a085-56b3346d34c8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Action: 'create', calling method: .version_select at 0x7fbfd48b3a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-889546097"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:27:50.144558 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-f88b8b0d-6f96-4685-a085-56b3346d34c8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Getting quotas for project c8cbe32e8ede404fa3d19537256606e1. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:27:50.150100 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-f88b8b0d-6f96-4685-a085-56b3346d34c8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Getting quotas for user dc01367aaf7742d8abdd0fdc4de64f6e and project c8cbe32e8ede404fa3d19537256606e1. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:27:50.198054 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b043c4b9-c53b-45eb-940d-5c775f9cec23 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:50.207280 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b043c4b9-c53b-45eb-940d-5c775f9cec23 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.488629 May 09 04:27:50.207915 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 125/229] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:49 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:27:50.564903 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-f88b8b0d-6f96-4685-a085-56b3346d34c8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Getting quotas for project c8cbe32e8ede404fa3d19537256606e1. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:27:50.573720 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-f88b8b0d-6f96-4685-a085-56b3346d34c8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Getting quotas for user dc01367aaf7742d8abdd0fdc4de64f6e and project c8cbe32e8ede404fa3d19537256606e1. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:27:50.600838 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f88b8b0d-6f96-4685-a085-56b3346d34c8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.065385 May 09 04:27:50.602716 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 105/230] 10.222.0.44 () {60 vars in 1157 bytes} [Mon May 9 04:27:49 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:51.226330 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-876f9a56-1e0b-42e9-a982-beaf476e80a3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:51.226941 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-876f9a56-1e0b-42e9-a982-beaf476e80a3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:51.236308 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-876f9a56-1e0b-42e9-a982-beaf476e80a3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:51.236597 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-876f9a56-1e0b-42e9-a982-beaf476e80a3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:51.255122 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-876f9a56-1e0b-42e9-a982-beaf476e80a3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:51.255928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-876f9a56-1e0b-42e9-a982-beaf476e80a3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:52.284787 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-876f9a56-1e0b-42e9-a982-beaf476e80a3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:52.306227 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-876f9a56-1e0b-42e9-a982-beaf476e80a3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 1.084536 May 09 04:27:52.308619 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 126/231] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:51 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:53.327508 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d6fe1c30-d3ba-4767-99bb-a840dfb1bfbc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:53.328884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d6fe1c30-d3ba-4767-99bb-a840dfb1bfbc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:53.344015 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d6fe1c30-d3ba-4767-99bb-a840dfb1bfbc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:53.348048 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d6fe1c30-d3ba-4767-99bb-a840dfb1bfbc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:53.350715 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d6fe1c30-d3ba-4767-99bb-a840dfb1bfbc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:53.352111 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d6fe1c30-d3ba-4767-99bb-a840dfb1bfbc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:53.696955 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d6fe1c30-d3ba-4767-99bb-a840dfb1bfbc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:53.715277 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d6fe1c30-d3ba-4767-99bb-a840dfb1bfbc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.393920 May 09 04:27:53.716515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 106/232] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:53 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:54.738355 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ed1b7f43-ef12-4691-b9bf-2fb92d9a744f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:54.744207 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ed1b7f43-ef12-4691-b9bf-2fb92d9a744f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:54.754062 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ed1b7f43-ef12-4691-b9bf-2fb92d9a744f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:54.754820 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ed1b7f43-ef12-4691-b9bf-2fb92d9a744f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:54.756954 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ed1b7f43-ef12-4691-b9bf-2fb92d9a744f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:54.757781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ed1b7f43-ef12-4691-b9bf-2fb92d9a744f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:55.216930 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ed1b7f43-ef12-4691-b9bf-2fb92d9a744f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:55.230359 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ed1b7f43-ef12-4691-b9bf-2fb92d9a744f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.501109 May 09 04:27:55.242999 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 127/233] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:54 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:56.266188 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3cf7d274-b1d7-4716-a4cf-b66ab34abfe4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:56.267564 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3cf7d274-b1d7-4716-a4cf-b66ab34abfe4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:56.297204 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3cf7d274-b1d7-4716-a4cf-b66ab34abfe4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:56.297758 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3cf7d274-b1d7-4716-a4cf-b66ab34abfe4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:56.298669 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3cf7d274-b1d7-4716-a4cf-b66ab34abfe4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:56.299112 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3cf7d274-b1d7-4716-a4cf-b66ab34abfe4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:56.922805 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3cf7d274-b1d7-4716-a4cf-b66ab34abfe4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:56.935529 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3cf7d274-b1d7-4716-a4cf-b66ab34abfe4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.677778 May 09 04:27:56.937374 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 107/234] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:56 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:57.954281 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-9b4d62ff-45b5-49cd-ad33-1af24d171613 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:57.954966 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-9b4d62ff-45b5-49cd-ad33-1af24d171613 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:57.966766 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9b4d62ff-45b5-49cd-ad33-1af24d171613 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:57.967366 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9b4d62ff-45b5-49cd-ad33-1af24d171613 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:57.968287 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9b4d62ff-45b5-49cd-ad33-1af24d171613 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:57.970059 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9b4d62ff-45b5-49cd-ad33-1af24d171613 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:58.911100 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9b4d62ff-45b5-49cd-ad33-1af24d171613 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:27:58.924737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-9b4d62ff-45b5-49cd-ad33-1af24d171613 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.972443 May 09 04:27:58.926019 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 128/235] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:57 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:27:59.944137 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-59677daf-da0a-49cc-9b25-3dda19ce8329 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:27:59.944889 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-59677daf-da0a-49cc-9b25-3dda19ce8329 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:27:59.967045 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59677daf-da0a-49cc-9b25-3dda19ce8329 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:59.968276 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59677daf-da0a-49cc-9b25-3dda19ce8329 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:27:59.979597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59677daf-da0a-49cc-9b25-3dda19ce8329 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:27:59.980264 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59677daf-da0a-49cc-9b25-3dda19ce8329 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:00.491070 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-59677daf-da0a-49cc-9b25-3dda19ce8329 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:00.516700 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-59677daf-da0a-49cc-9b25-3dda19ce8329 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.577800 May 09 04:28:00.517286 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 108/236] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:27:59 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:01.535073 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-997e3f57-98f2-496a-b819-cce21326cc40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:01.536359 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-997e3f57-98f2-496a-b819-cce21326cc40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:01.547915 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-997e3f57-98f2-496a-b819-cce21326cc40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:01.550052 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-997e3f57-98f2-496a-b819-cce21326cc40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:01.554063 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-997e3f57-98f2-496a-b819-cce21326cc40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:01.556091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-997e3f57-98f2-496a-b819-cce21326cc40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:02.463961 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-997e3f57-98f2-496a-b819-cce21326cc40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:02.477582 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-997e3f57-98f2-496a-b819-cce21326cc40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.944323 May 09 04:28:02.478429 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 129/237] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:01 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:03.496516 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6e079b56-aaae-4e3e-86b8-ddb2ff19a8ea tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:03.497085 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6e079b56-aaae-4e3e-86b8-ddb2ff19a8ea tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:03.525979 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6e079b56-aaae-4e3e-86b8-ddb2ff19a8ea tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:03.526480 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6e079b56-aaae-4e3e-86b8-ddb2ff19a8ea tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:03.527230 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6e079b56-aaae-4e3e-86b8-ddb2ff19a8ea tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:03.527667 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6e079b56-aaae-4e3e-86b8-ddb2ff19a8ea tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:03.807152 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6e079b56-aaae-4e3e-86b8-ddb2ff19a8ea tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:03.817675 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6e079b56-aaae-4e3e-86b8-ddb2ff19a8ea tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.326128 May 09 04:28:03.818634 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 109/238] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:03 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:04.715752 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-34e13d35-041e-44c3-94f0-99f6410cdfb4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Action: 'create', calling method: .version_select at 0x7fbfd48d4700>, body: {"keypair": {"name": "tempest-keypair-585694648"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:04.781528 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-34e13d35-041e-44c3-94f0-99f6410cdfb4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:28:04.807357 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-34e13d35-041e-44c3-94f0-99f6410cdfb4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for user c56a403eeee84720ba765e2d4367df74 and project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:28:04.837161 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-17d279dd-5607-4d45-a53f-d96b10210156 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:04.838510 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-17d279dd-5607-4d45-a53f-d96b10210156 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:04.853607 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17d279dd-5607-4d45-a53f-d96b10210156 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:04.856189 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17d279dd-5607-4d45-a53f-d96b10210156 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:04.860491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17d279dd-5607-4d45-a53f-d96b10210156 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:04.861316 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17d279dd-5607-4d45-a53f-d96b10210156 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:05.149860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-34e13d35-041e-44c3-94f0-99f6410cdfb4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:28:05.155289 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-34e13d35-041e-44c3-94f0-99f6410cdfb4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for user c56a403eeee84720ba765e2d4367df74 and project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:28:05.172540 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-34e13d35-041e-44c3-94f0-99f6410cdfb4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.969887 May 09 04:28:05.173955 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 130/239] 10.222.0.44 () {60 vars in 1157 bytes} [Mon May 9 04:28:04 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:05.221379 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-17d279dd-5607-4d45-a53f-d96b10210156 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:05.243139 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-17d279dd-5607-4d45-a53f-d96b10210156 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.411578 May 09 04:28:05.244305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 110/240] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:04 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:06.281933 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5bdefcb1-ee13-4e80-8b52-35cadfa10350 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:06.282762 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5bdefcb1-ee13-4e80-8b52-35cadfa10350 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:06.300215 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5bdefcb1-ee13-4e80-8b52-35cadfa10350 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:06.300689 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5bdefcb1-ee13-4e80-8b52-35cadfa10350 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:06.303542 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5bdefcb1-ee13-4e80-8b52-35cadfa10350 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:06.305284 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5bdefcb1-ee13-4e80-8b52-35cadfa10350 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:07.093202 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5bdefcb1-ee13-4e80-8b52-35cadfa10350 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:07.101241 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5bdefcb1-ee13-4e80-8b52-35cadfa10350 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.827223 May 09 04:28:07.108110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 131/241] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:06 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:08.070315 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2066371155", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cff1ca97-0d5c-4d7d-b3c2-a81f844b16da"}], "security_groups": [{"name": "tempest-securitygroup--613897689"}], "key_name": "tempest-keypair-585694648", "user_data": "}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:08.124828 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b8d72b9a-3dcc-4eb4-8730-73200da6275d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:08.126246 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b8d72b9a-3dcc-4eb4-8730-73200da6275d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:08.135183 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b8d72b9a-3dcc-4eb4-8730-73200da6275d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:08.135807 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b8d72b9a-3dcc-4eb4-8730-73200da6275d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:08.136787 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b8d72b9a-3dcc-4eb4-8730-73200da6275d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:08.137379 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b8d72b9a-3dcc-4eb4-8730-73200da6275d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:08.296286 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] validate_networks() for [('cff1ca97-0d5c-4d7d-b3c2-a81f844b16da', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:28:08.580039 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b8d72b9a-3dcc-4eb4-8730-73200da6275d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:08.596292 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b8d72b9a-3dcc-4eb4-8730-73200da6275d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.475203 May 09 04:28:08.606402 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 132/242] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:08 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:09.259801 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:28:09.260404 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:28:09.260706 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:28:09.261113 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:28:09.261519 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:28:09.272712 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d6247849-22a6-46c9-8e20-86e5ec9f118f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Action: 'create', calling method: .version_select at 0x7fbfd4701dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-901938689"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:09.278331 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:09.279015 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:09.280103 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:09.280617 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:09.289874 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-d6247849-22a6-46c9-8e20-86e5ec9f118f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Getting quotas for project b6223852af9c4361b99a24e7a49a7734. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:28:09.294503 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-d6247849-22a6-46c9-8e20-86e5ec9f118f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Getting quotas for user cb34feb512764ec5b9ca25c30c3d7159 and project b6223852af9c4361b99a24e7a49a7734. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:28:09.310645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:28:09.316838 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for user c56a403eeee84720ba765e2d4367df74 and project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:28:09.333320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:28:09.336578 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:28:09.400394 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-28a4197c-baac-4c99-bfd0-c70bbeb7742f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.334922 May 09 04:28:09.407973 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 111/243] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:28:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:28:09.418698 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-045ed724-8348-4b0a-9dc4-cba761fbb2a6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:09.420207 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-045ed724-8348-4b0a-9dc4-cba761fbb2a6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:09.589542 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-045ed724-8348-4b0a-9dc4-cba761fbb2a6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:09.604397 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-045ed724-8348-4b0a-9dc4-cba761fbb2a6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1241 microversion: 2.1 time: 0.193409 May 09 04:28:09.614044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 112/244] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:09 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1241 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:09.634210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d2bae4c6-0e77-4d83-9ad3-872b8fe73658 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:09.635422 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d2bae4c6-0e77-4d83-9ad3-872b8fe73658 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:09.645452 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d2bae4c6-0e77-4d83-9ad3-872b8fe73658 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:09.647340 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d2bae4c6-0e77-4d83-9ad3-872b8fe73658 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:09.648392 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d2bae4c6-0e77-4d83-9ad3-872b8fe73658 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:09.649066 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d2bae4c6-0e77-4d83-9ad3-872b8fe73658 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:09.820513 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-d6247849-22a6-46c9-8e20-86e5ec9f118f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Getting quotas for project b6223852af9c4361b99a24e7a49a7734. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:28:09.827988 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-d6247849-22a6-46c9-8e20-86e5ec9f118f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Getting quotas for user cb34feb512764ec5b9ca25c30c3d7159 and project b6223852af9c4361b99a24e7a49a7734. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:28:09.865815 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d6247849-22a6-46c9-8e20-86e5ec9f118f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.968758 May 09 04:28:09.869417 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 133/245] 10.222.0.44 () {60 vars in 1157 bytes} [Mon May 9 04:28:08 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:09.913935 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d2bae4c6-0e77-4d83-9ad3-872b8fe73658 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:09.923431 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d2bae4c6-0e77-4d83-9ad3-872b8fe73658 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.307477 May 09 04:28:09.924441 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 113/246] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:09 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:10.632293 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f2e18637-04f0-420f-8b4c-65ba992b44a8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:10.635269 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f2e18637-04f0-420f-8b4c-65ba992b44a8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:10.649765 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f2e18637-04f0-420f-8b4c-65ba992b44a8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:10.660855 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f2e18637-04f0-420f-8b4c-65ba992b44a8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:10.669888 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f2e18637-04f0-420f-8b4c-65ba992b44a8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:10.670576 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f2e18637-04f0-420f-8b4c-65ba992b44a8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:10.950447 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7725ffb9-924a-4f48-96ed-619dbe7c542a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:10.953539 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7725ffb9-924a-4f48-96ed-619dbe7c542a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:10.979687 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7725ffb9-924a-4f48-96ed-619dbe7c542a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:10.982588 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7725ffb9-924a-4f48-96ed-619dbe7c542a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:10.985623 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7725ffb9-924a-4f48-96ed-619dbe7c542a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:10.986844 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7725ffb9-924a-4f48-96ed-619dbe7c542a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:11.016130 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f2e18637-04f0-420f-8b4c-65ba992b44a8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:11.026288 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f2e18637-04f0-420f-8b4c-65ba992b44a8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1237 microversion: 2.1 time: 0.399156 May 09 04:28:11.029366 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 134/247] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:10 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1237 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:11.404265 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7725ffb9-924a-4f48-96ed-619dbe7c542a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:11.413091 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7725ffb9-924a-4f48-96ed-619dbe7c542a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.474402 May 09 04:28:11.416985 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 114/248] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:10 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:12.046468 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3c4fc948-29a8-4dde-9991-3cfc02e02cc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:12.048105 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-3c4fc948-29a8-4dde-9991-3cfc02e02cc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:12.062373 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3c4fc948-29a8-4dde-9991-3cfc02e02cc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:12.063314 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3c4fc948-29a8-4dde-9991-3cfc02e02cc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:12.064826 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3c4fc948-29a8-4dde-9991-3cfc02e02cc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:12.069601 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3c4fc948-29a8-4dde-9991-3cfc02e02cc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:12.433083 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-62db8960-3211-4c45-acd6-14dd209971a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:12.433700 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-62db8960-3211-4c45-acd6-14dd209971a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:12.443741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-62db8960-3211-4c45-acd6-14dd209971a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:12.456115 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-62db8960-3211-4c45-acd6-14dd209971a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:12.459423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-62db8960-3211-4c45-acd6-14dd209971a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:12.460113 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-62db8960-3211-4c45-acd6-14dd209971a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:12.512376 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3c4fc948-29a8-4dde-9991-3cfc02e02cc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:12.526800 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-3c4fc948-29a8-4dde-9991-3cfc02e02cc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1299 microversion: 2.1 time: 0.486331 May 09 04:28:12.527482 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 135/249] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:12 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1299 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:12.676464 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-825d6f2f-6b7c-4dff-9daf-8674b44f05ec tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:12.676968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-825d6f2f-6b7c-4dff-9daf-8674b44f05ec tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:12.692623 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-825d6f2f-6b7c-4dff-9daf-8674b44f05ec tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:12.696595 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-825d6f2f-6b7c-4dff-9daf-8674b44f05ec tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:12.697712 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-825d6f2f-6b7c-4dff-9daf-8674b44f05ec tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:12.699158 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-825d6f2f-6b7c-4dff-9daf-8674b44f05ec tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:12.764799 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-825d6f2f-6b7c-4dff-9daf-8674b44f05ec tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/ips" status: 200 len: 151 microversion: 2.20 time: 0.088759 May 09 04:28:12.771598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 136/250] 10.222.0.44 () {60 vars in 1288 bytes} [Mon May 9 04:28:12 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/ips => generated 151 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 04:28:13.049607 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-62db8960-3211-4c45-acd6-14dd209971a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:13.061812 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-62db8960-3211-4c45-acd6-14dd209971a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.632493 May 09 04:28:13.063657 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 115/251] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:12 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:13.550814 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-2bf54c8f-0891-483d-8b98-cfe84a9674f6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:13.552823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-2bf54c8f-0891-483d-8b98-cfe84a9674f6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:13.572651 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2bf54c8f-0891-483d-8b98-cfe84a9674f6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:13.573105 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2bf54c8f-0891-483d-8b98-cfe84a9674f6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:13.576494 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2bf54c8f-0891-483d-8b98-cfe84a9674f6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:13.577972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2bf54c8f-0891-483d-8b98-cfe84a9674f6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:13.880305 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-2bf54c8f-0891-483d-8b98-cfe84a9674f6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:13.905782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-2bf54c8f-0891-483d-8b98-cfe84a9674f6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1299 microversion: 2.1 time: 0.362939 May 09 04:28:13.923194 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 137/252] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:13 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1299 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:14.080946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fa18ddb6-ecdc-4e23-82d0-e7ef7acd33d8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:14.081569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fa18ddb6-ecdc-4e23-82d0-e7ef7acd33d8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:14.095390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa18ddb6-ecdc-4e23-82d0-e7ef7acd33d8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:14.102416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa18ddb6-ecdc-4e23-82d0-e7ef7acd33d8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:14.105891 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa18ddb6-ecdc-4e23-82d0-e7ef7acd33d8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:14.111717 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa18ddb6-ecdc-4e23-82d0-e7ef7acd33d8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:14.530756 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6db5d24d-677a-493a-8d4c-45e83afc9eec tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:14.531512 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6db5d24d-677a-493a-8d4c-45e83afc9eec tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:14.558837 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6db5d24d-677a-493a-8d4c-45e83afc9eec tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:14.559468 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6db5d24d-677a-493a-8d4c-45e83afc9eec tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:14.560814 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6db5d24d-677a-493a-8d4c-45e83afc9eec tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:14.580465 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6db5d24d-677a-493a-8d4c-45e83afc9eec tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:14.629727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fa18ddb6-ecdc-4e23-82d0-e7ef7acd33d8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:14.646867 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fa18ddb6-ecdc-4e23-82d0-e7ef7acd33d8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.568723 May 09 04:28:14.670656 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 116/253] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:14 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:14.703361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-379810047", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-889546097", "security_groups": [{"name": "tempest-secgroup-smoke-992687064"}], "networks": [{"uuid": "6b94aa6a-0d58-466c-8eb9-c480de2276aa"}], "block_device_mapping_v2": [{"uuid": "85f38352-afa5-4b59-aeac-b9f85e962467", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:14.771159 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6db5d24d-677a-493a-8d4c-45e83afc9eec tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/ips" status: 200 len: 147 microversion: 2.1 time: 0.245565 May 09 04:28:14.780089 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 138/254] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 04:28:14 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/ips => generated 147 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:28:14.927331 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-26c977e7-7299-4726-9194-07425f126178 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:14.929178 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-26c977e7-7299-4726-9194-07425f126178 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:14.950078 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-26c977e7-7299-4726-9194-07425f126178 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:14.950545 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-26c977e7-7299-4726-9194-07425f126178 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:14.951332 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-26c977e7-7299-4726-9194-07425f126178 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:14.954865 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-26c977e7-7299-4726-9194-07425f126178 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:15.020354 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] validate_networks() for [('6b94aa6a-0d58-466c-8eb9-c480de2276aa', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:28:15.792688 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-26c977e7-7299-4726-9194-07425f126178 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:15.808077 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-26c977e7-7299-4726-9194-07425f126178 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1366 microversion: 2.1 time: 0.879305 May 09 04:28:15.808764 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 139/255] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:14 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1366 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:15.828887 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c4bc23ce-f066-45b3-a881-122d8a8ea2dd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:15.867096 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c4bc23ce-f066-45b3-a881-122d8a8ea2dd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:15.894183 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c4bc23ce-f066-45b3-a881-122d8a8ea2dd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:15.904857 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c4bc23ce-f066-45b3-a881-122d8a8ea2dd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:15.907261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c4bc23ce-f066-45b3-a881-122d8a8ea2dd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:15.907710 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c4bc23ce-f066-45b3-a881-122d8a8ea2dd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:15.948793 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:28:15.950363 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:28:15.951061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:28:15.951849 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:28:15.952699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:28:15.971363 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:15.975581 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:15.976694 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:15.979656 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.objects.instance [None req-c4bc23ce-f066-45b3-a881-122d8a8ea2dd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lazy-loading 'flavor' on Instance uuid d10350c6-bf15-414f-9bf7-d371b6912be2 {{(pid=117033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:28:15.980364 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:16.015281 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Getting quotas for project c8cbe32e8ede404fa3d19537256606e1. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:28:16.031181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Getting quotas for user dc01367aaf7742d8abdd0fdc4de64f6e and project c8cbe32e8ede404fa3d19537256606e1. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:28:16.140511 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:28:16.143407 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='85f38352-afa5-4b59-aeac-b9f85e962467',volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:28:16.589442 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-059b3218-480f-4cf9-b687-20e75dae3c52 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.914833 May 09 04:28:16.595695 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 117/256] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:28:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:28:16.623718 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-55839c24-0e85-46c4-b7df-6353595c2f4f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:16.632431 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-55839c24-0e85-46c4-b7df-6353595c2f4f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:16.666737 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-55839c24-0e85-46c4-b7df-6353595c2f4f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:16.668703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-55839c24-0e85-46c4-b7df-6353595c2f4f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:16.672320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-55839c24-0e85-46c4-b7df-6353595c2f4f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:16.675530 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-55839c24-0e85-46c4-b7df-6353595c2f4f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:17.406275 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-55839c24-0e85-46c4-b7df-6353595c2f4f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:17.418542 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-55839c24-0e85-46c4-b7df-6353595c2f4f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1521 microversion: 2.1 time: 0.821419 May 09 04:28:17.423617 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 118/257] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:16 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1521 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:17.442033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9fb2f66d-ac63-4cbf-859c-fcb9bc4f71d1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:17.443112 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9fb2f66d-ac63-4cbf-859c-fcb9bc4f71d1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:17.837825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9fb2f66d-ac63-4cbf-859c-fcb9bc4f71d1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:17.845756 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9fb2f66d-ac63-4cbf-859c-fcb9bc4f71d1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1087 microversion: 2.1 time: 0.417871 May 09 04:28:17.854656 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 119/258] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:17 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1087 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:17.888156 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-609d6ad1-0195-4ae8-a1a4-e31e45c3cdbb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:17.891022 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-609d6ad1-0195-4ae8-a1a4-e31e45c3cdbb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:17.899511 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-609d6ad1-0195-4ae8-a1a4-e31e45c3cdbb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:17.900467 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-609d6ad1-0195-4ae8-a1a4-e31e45c3cdbb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:17.901793 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-609d6ad1-0195-4ae8-a1a4-e31e45c3cdbb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:17.908183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-609d6ad1-0195-4ae8-a1a4-e31e45c3cdbb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:18.418733 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-609d6ad1-0195-4ae8-a1a4-e31e45c3cdbb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:18.439684 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-609d6ad1-0195-4ae8-a1a4-e31e45c3cdbb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1366 microversion: 2.1 time: 0.578326 May 09 04:28:18.440819 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 120/259] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:17 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1366 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:18.469262 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-db7c3d5c-bd9c-417d-b4d1-e2a61a5e3da6 req-5f8bfb04-c7e4-48dc-bce0-bd2b57b4533e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48735dde-9de8-4b71-877f-e86789f4c887", "tag": "1e27a9e1-6f10-43bb-909c-aa9fc82bc83c"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:18.503043 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-db7c3d5c-bd9c-417d-b4d1-e2a61a5e3da6 req-5f8bfb04-c7e4-48dc-bce0-bd2b57b4533e service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:18.504428 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-db7c3d5c-bd9c-417d-b4d1-e2a61a5e3da6 req-5f8bfb04-c7e4-48dc-bce0-bd2b57b4533e service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:18.557720 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-db7c3d5c-bd9c-417d-b4d1-e2a61a5e3da6 req-5f8bfb04-c7e4-48dc-bce0-bd2b57b4533e service nova] Creating event network-changed:1e27a9e1-6f10-43bb-909c-aa9fc82bc83c for instance 48735dde-9de8-4b71-877f-e86789f4c887 on hv-cinder-83800 May 09 04:28:18.576296 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-db7c3d5c-bd9c-417d-b4d1-e2a61a5e3da6 req-5f8bfb04-c7e4-48dc-bce0-bd2b57b4533e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121105 May 09 04:28:18.580019 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 121/260] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:28:18.595840 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-04d25fdc-9689-4ec8-b842-a81cdf71a041 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:18.603388 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-04d25fdc-9689-4ec8-b842-a81cdf71a041 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:18.638300 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04d25fdc-9689-4ec8-b842-a81cdf71a041 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:18.640038 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04d25fdc-9689-4ec8-b842-a81cdf71a041 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:18.642137 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04d25fdc-9689-4ec8-b842-a81cdf71a041 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:18.648331 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04d25fdc-9689-4ec8-b842-a81cdf71a041 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:19.318801 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-04d25fdc-9689-4ec8-b842-a81cdf71a041 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:19.326930 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-04d25fdc-9689-4ec8-b842-a81cdf71a041 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1501 microversion: 2.1 time: 0.741403 May 09 04:28:19.327506 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 122/261] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:18 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1501 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:19.340683 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c90e211d-8f33-402c-a594-54313f36eab1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "257f75e5-ec01-473d-a2dd-b1ade5036461"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:19.341790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c90e211d-8f33-402c-a594-54313f36eab1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:19.357855 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c90e211d-8f33-402c-a594-54313f36eab1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:19.362691 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c90e211d-8f33-402c-a594-54313f36eab1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:19.365572 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c90e211d-8f33-402c-a594-54313f36eab1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:19.366188 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c90e211d-8f33-402c-a594-54313f36eab1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:20.828376 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c90e211d-8f33-402c-a594-54313f36eab1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "POST /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.499538 May 09 04:28:20.829130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 123/262] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 04:28:19 2022] POST /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/os-volume_attachments => generated 194 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:28:20.851008 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-de5b58ee-318e-4522-87c2-75455421ddfb tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:20.856897 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-de5b58ee-318e-4522-87c2-75455421ddfb tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:20.875249 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-de5b58ee-318e-4522-87c2-75455421ddfb tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:20.876279 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-de5b58ee-318e-4522-87c2-75455421ddfb tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:20.876501 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-de5b58ee-318e-4522-87c2-75455421ddfb tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:20.885590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-de5b58ee-318e-4522-87c2-75455421ddfb tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:21.096934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-de5b58ee-318e-4522-87c2-75455421ddfb tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:21.110899 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-de5b58ee-318e-4522-87c2-75455421ddfb tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1203 microversion: 2.1 time: 0.275627 May 09 04:28:21.117627 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 124/263] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:20 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1203 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:21.132159 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6ca883d4-741b-4043-b6ab-819e4b370800 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:21.133619 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6ca883d4-741b-4043-b6ab-819e4b370800 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:21.157437 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6ca883d4-741b-4043-b6ab-819e4b370800 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:21.157895 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6ca883d4-741b-4043-b6ab-819e4b370800 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:21.158703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6ca883d4-741b-4043-b6ab-819e4b370800 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:21.162133 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6ca883d4-741b-4043-b6ab-819e4b370800 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:21.663667 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6ca883d4-741b-4043-b6ab-819e4b370800 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:21.681273 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6ca883d4-741b-4043-b6ab-819e4b370800 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1515 microversion: 2.1 time: 0.561672 May 09 04:28:21.682437 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 125/264] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:21 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1515 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:21.687271 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-363c5c06-c084-465c-99ef-d9c16bc0572f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:21.694921 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-363c5c06-c084-465c-99ef-d9c16bc0572f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:21.717685 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-363c5c06-c084-465c-99ef-d9c16bc0572f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:21.718145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-363c5c06-c084-465c-99ef-d9c16bc0572f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:21.718936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-363c5c06-c084-465c-99ef-d9c16bc0572f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:21.719384 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-363c5c06-c084-465c-99ef-d9c16bc0572f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:22.216616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-363c5c06-c084-465c-99ef-d9c16bc0572f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:22.225421 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-363c5c06-c084-465c-99ef-d9c16bc0572f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1366 microversion: 2.1 time: 0.541705 May 09 04:28:22.228647 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 126/265] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:21 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1366 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:22.243871 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1a82aa71-df2f-4cf0-bbe4-103c0fc20166 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:22.244527 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1a82aa71-df2f-4cf0-bbe4-103c0fc20166 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:22.262051 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1a82aa71-df2f-4cf0-bbe4-103c0fc20166 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:22.262884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1a82aa71-df2f-4cf0-bbe4-103c0fc20166 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:22.263770 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1a82aa71-df2f-4cf0-bbe4-103c0fc20166 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:22.264434 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1a82aa71-df2f-4cf0-bbe4-103c0fc20166 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:22.411906 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1a82aa71-df2f-4cf0-bbe4-103c0fc20166 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:22.420050 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1a82aa71-df2f-4cf0-bbe4-103c0fc20166 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1191 microversion: 2.1 time: 0.179971 May 09 04:28:22.420856 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 127/266] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:22 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1191 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:23.250367 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dc90316b-174a-4b41-8eb9-a41228d4720e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:23.251656 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dc90316b-174a-4b41-8eb9-a41228d4720e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:23.277280 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc90316b-174a-4b41-8eb9-a41228d4720e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:23.277458 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc90316b-174a-4b41-8eb9-a41228d4720e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:23.278777 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc90316b-174a-4b41-8eb9-a41228d4720e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:23.279555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc90316b-174a-4b41-8eb9-a41228d4720e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:23.522351 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dc90316b-174a-4b41-8eb9-a41228d4720e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:23.537133 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dc90316b-174a-4b41-8eb9-a41228d4720e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1366 microversion: 2.1 time: 0.292042 May 09 04:28:23.537738 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 128/267] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:23 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:23.546587 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-de3a382e-2a93-4292-96e7-f7e82827a667 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:23.553990 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-de3a382e-2a93-4292-96e7-f7e82827a667 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:23.575341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-de3a382e-2a93-4292-96e7-f7e82827a667 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:23.577259 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-de3a382e-2a93-4292-96e7-f7e82827a667 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:23.580020 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-de3a382e-2a93-4292-96e7-f7e82827a667 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:23.580728 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-de3a382e-2a93-4292-96e7-f7e82827a667 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:23.648097 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-de3a382e-2a93-4292-96e7-f7e82827a667 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lazy-loading 'flavor' on Instance uuid 6774e618-8e5f-4815-8e60-0473be16aabc {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:28:23.803372 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-de3a382e-2a93-4292-96e7-f7e82827a667 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "POST /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc/action" status: 200 len: 32 microversion: 2.1 time: 0.261573 May 09 04:28:23.804007 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 129/268] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 04:28:23 2022] POST /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc/action => generated 32 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 04:28:23.824183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c5f3f8a8-6867-42f7-95de-c837ae13bdbe tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:23.824733 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c5f3f8a8-6867-42f7-95de-c837ae13bdbe tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:23.843865 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5f3f8a8-6867-42f7-95de-c837ae13bdbe tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:23.844399 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5f3f8a8-6867-42f7-95de-c837ae13bdbe tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:23.845361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5f3f8a8-6867-42f7-95de-c837ae13bdbe tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:23.848011 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5f3f8a8-6867-42f7-95de-c837ae13bdbe tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:24.497206 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c5f3f8a8-6867-42f7-95de-c837ae13bdbe tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:24.509321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c5f3f8a8-6867-42f7-95de-c837ae13bdbe tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.703010 May 09 04:28:24.509923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 130/269] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:23 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:24.520660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2b19c8f9-bbc0-4e43-ac54-0bba029a6bf8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:24.531003 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2b19c8f9-bbc0-4e43-ac54-0bba029a6bf8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:24.545148 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b19c8f9-bbc0-4e43-ac54-0bba029a6bf8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:24.545955 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b19c8f9-bbc0-4e43-ac54-0bba029a6bf8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:24.547085 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b19c8f9-bbc0-4e43-ac54-0bba029a6bf8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:24.547828 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b19c8f9-bbc0-4e43-ac54-0bba029a6bf8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:24.914563 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2b19c8f9-bbc0-4e43-ac54-0bba029a6bf8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:24.931390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2b19c8f9-bbc0-4e43-ac54-0bba029a6bf8 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.417700 May 09 04:28:24.939590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 131/270] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:24 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:24.947318 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8e53f9c6-dd47-4128-aad5-59352707b21b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:24.951554 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8e53f9c6-dd47-4128-aad5-59352707b21b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:24.985832 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8e53f9c6-dd47-4128-aad5-59352707b21b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:24.986534 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8e53f9c6-dd47-4128-aad5-59352707b21b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:24.987468 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8e53f9c6-dd47-4128-aad5-59352707b21b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:24.989756 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8e53f9c6-dd47-4128-aad5-59352707b21b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:25.629046 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8e53f9c6-dd47-4128-aad5-59352707b21b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:25.643060 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8e53f9c6-dd47-4128-aad5-59352707b21b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1366 microversion: 2.1 time: 0.701994 May 09 04:28:25.646510 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 132/271] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:24 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1366 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:25.651743 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-0ac17795-1db9-472b-8640-953974f68bf7 req-0603cc0f-aeaa-4218-aac7-ef1e3e559363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a541a008-c541-407b-8868-a2b9d98ed15d", "tag": "8b3c8f68-461e-4b7f-843a-747af41739b1"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:25.662314 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-0ac17795-1db9-472b-8640-953974f68bf7 req-0603cc0f-aeaa-4218-aac7-ef1e3e559363 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:25.663039 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-0ac17795-1db9-472b-8640-953974f68bf7 req-0603cc0f-aeaa-4218-aac7-ef1e3e559363 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:25.691767 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-0ac17795-1db9-472b-8640-953974f68bf7 req-0603cc0f-aeaa-4218-aac7-ef1e3e559363 service nova] Creating event network-changed:8b3c8f68-461e-4b7f-843a-747af41739b1 for instance a541a008-c541-407b-8868-a2b9d98ed15d on hv-cinder-83800 May 09 04:28:25.697411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-0ac17795-1db9-472b-8640-953974f68bf7 req-0603cc0f-aeaa-4218-aac7-ef1e3e559363 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049392 May 09 04:28:25.698750 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 133/272] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:28:25.704825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6109956f-fae6-416f-a205-cfab4314d322 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:25.709807 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6109956f-fae6-416f-a205-cfab4314d322 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:25.727016 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6109956f-fae6-416f-a205-cfab4314d322 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:25.727655 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6109956f-fae6-416f-a205-cfab4314d322 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:25.728663 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6109956f-fae6-416f-a205-cfab4314d322 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:25.729097 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6109956f-fae6-416f-a205-cfab4314d322 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:26.155432 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6109956f-fae6-416f-a205-cfab4314d322 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:26.163763 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6109956f-fae6-416f-a205-cfab4314d322 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.463662 May 09 04:28:26.170497 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 134/273] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:25 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:26.194879 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-352624af-0df0-45fa-9149-eb07eb33af9c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:26.196614 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-352624af-0df0-45fa-9149-eb07eb33af9c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:26.206443 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c4bc23ce-f066-45b3-a881-122d8a8ea2dd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "POST /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/action" status: 202 len: 0 microversion: 2.20 time: 10.381265 May 09 04:28:26.217296 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 140/274] 10.222.0.44 () {62 vars in 1318 bytes} [Mon May 9 04:28:15 2022] POST /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/action => generated 0 bytes in 10408 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 04:28:26.223047 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-352624af-0df0-45fa-9149-eb07eb33af9c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:26.223532 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-352624af-0df0-45fa-9149-eb07eb33af9c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:26.229300 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-81510d14-4b57-4db7-9464-1f58a2be322b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:26.230010 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-81510d14-4b57-4db7-9464-1f58a2be322b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:26.233442 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-352624af-0df0-45fa-9149-eb07eb33af9c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:26.234388 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-352624af-0df0-45fa-9149-eb07eb33af9c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:26.249876 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-81510d14-4b57-4db7-9464-1f58a2be322b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:26.250337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-81510d14-4b57-4db7-9464-1f58a2be322b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:26.251136 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-81510d14-4b57-4db7-9464-1f58a2be322b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:26.251574 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-81510d14-4b57-4db7-9464-1f58a2be322b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:26.517033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-352624af-0df0-45fa-9149-eb07eb33af9c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:26.528426 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-352624af-0df0-45fa-9149-eb07eb33af9c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.356389 May 09 04:28:26.538871 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 135/275] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:26 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:26.590690 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-81510d14-4b57-4db7-9464-1f58a2be322b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:26.600705 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-81510d14-4b57-4db7-9464-1f58a2be322b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:26.603670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-81510d14-4b57-4db7-9464-1f58a2be322b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:26.605830 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-81510d14-4b57-4db7-9464-1f58a2be322b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.387340 May 09 04:28:26.621395 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 141/276] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:26 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:26.662998 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9522a5d6-6c29-4c7c-ada8-d0bca937444a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:26.663662 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9522a5d6-6c29-4c7c-ada8-d0bca937444a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:26.674627 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9522a5d6-6c29-4c7c-ada8-d0bca937444a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:26.675079 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9522a5d6-6c29-4c7c-ada8-d0bca937444a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:26.676071 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9522a5d6-6c29-4c7c-ada8-d0bca937444a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:26.676505 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9522a5d6-6c29-4c7c-ada8-d0bca937444a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:26.970457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9522a5d6-6c29-4c7c-ada8-d0bca937444a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:26.979378 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9522a5d6-6c29-4c7c-ada8-d0bca937444a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1366 microversion: 2.1 time: 0.321488 May 09 04:28:26.979980 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 136/277] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:26 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:27.191013 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-76048e81-d5ba-4131-a7f9-af792e8caf91 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:27.194886 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-76048e81-d5ba-4131-a7f9-af792e8caf91 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:27.213401 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-76048e81-d5ba-4131-a7f9-af792e8caf91 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:27.214550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-76048e81-d5ba-4131-a7f9-af792e8caf91 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:27.216883 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-76048e81-d5ba-4131-a7f9-af792e8caf91 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:27.217584 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-76048e81-d5ba-4131-a7f9-af792e8caf91 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:27.546001 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8b20bd3a-e104-4070-8642-199ad1f864be tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:27.546817 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8b20bd3a-e104-4070-8642-199ad1f864be tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:27.564797 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b20bd3a-e104-4070-8642-199ad1f864be tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:27.568517 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b20bd3a-e104-4070-8642-199ad1f864be tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:27.570107 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b20bd3a-e104-4070-8642-199ad1f864be tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:27.572190 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b20bd3a-e104-4070-8642-199ad1f864be tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:27.675030 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-76048e81-d5ba-4131-a7f9-af792e8caf91 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:27.685695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-76048e81-d5ba-4131-a7f9-af792e8caf91 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.501277 May 09 04:28:27.690137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 142/278] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:27 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:27.707710 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-81176cff-730d-40f1-8beb-5d6fa590de14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:27.709112 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-81176cff-730d-40f1-8beb-5d6fa590de14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:27.725099 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-81176cff-730d-40f1-8beb-5d6fa590de14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:27.725099 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-81176cff-730d-40f1-8beb-5d6fa590de14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:27.725099 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-81176cff-730d-40f1-8beb-5d6fa590de14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:27.725099 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-81176cff-730d-40f1-8beb-5d6fa590de14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:28.128886 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-81176cff-730d-40f1-8beb-5d6fa590de14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:28.140545 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-81176cff-730d-40f1-8beb-5d6fa590de14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:28.142155 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-81176cff-730d-40f1-8beb-5d6fa590de14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:28.143626 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-81176cff-730d-40f1-8beb-5d6fa590de14 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.451653 May 09 04:28:28.144740 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 143/279] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:27 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:28.151200 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-7b6cd703-e8c1-4969-8d30-d52733dc1418 req-6724c036-eb29-453e-bd32-d0ab80d4c948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48735dde-9de8-4b71-877f-e86789f4c887", "name": "network-vif-plugged", "status": "completed", "tag": "1e27a9e1-6f10-43bb-909c-aa9fc82bc83c"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:28.159802 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-7b6cd703-e8c1-4969-8d30-d52733dc1418 req-6724c036-eb29-453e-bd32-d0ab80d4c948 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:28.160950 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-7b6cd703-e8c1-4969-8d30-d52733dc1418 req-6724c036-eb29-453e-bd32-d0ab80d4c948 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:28.176798 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-7b6cd703-e8c1-4969-8d30-d52733dc1418 req-6724c036-eb29-453e-bd32-d0ab80d4c948 service nova] Creating event network-vif-plugged:1e27a9e1-6f10-43bb-909c-aa9fc82bc83c for instance 48735dde-9de8-4b71-877f-e86789f4c887 on hv-cinder-83800 May 09 04:28:28.184259 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-7b6cd703-e8c1-4969-8d30-d52733dc1418 req-6724c036-eb29-453e-bd32-d0ab80d4c948 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037358 May 09 04:28:28.185504 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 144/280] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:28:28.192179 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5c06fc43-9d44-4d18-b776-3496d43d6404 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:28.193932 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5c06fc43-9d44-4d18-b776-3496d43d6404 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:28.195360 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8b20bd3a-e104-4070-8642-199ad1f864be tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:28.205090 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8b20bd3a-e104-4070-8642-199ad1f864be tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.663285 May 09 04:28:28.215209 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5c06fc43-9d44-4d18-b776-3496d43d6404 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:28.216286 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5c06fc43-9d44-4d18-b776-3496d43d6404 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:28.216878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 137/281] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:27 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:28.217619 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5c06fc43-9d44-4d18-b776-3496d43d6404 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:28.218065 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5c06fc43-9d44-4d18-b776-3496d43d6404 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:28.439497 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5c06fc43-9d44-4d18-b776-3496d43d6404 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:28.448892 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5c06fc43-9d44-4d18-b776-3496d43d6404 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1366 microversion: 2.1 time: 0.262020 May 09 04:28:28.460437 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 145/282] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:28 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:28.734270 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7b0efe9a-454e-4bdd-95c7-bd4b408d2812 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:28.734997 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7b0efe9a-454e-4bdd-95c7-bd4b408d2812 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:28.742331 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7b0efe9a-454e-4bdd-95c7-bd4b408d2812 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:28.745340 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7b0efe9a-454e-4bdd-95c7-bd4b408d2812 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:28.746178 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7b0efe9a-454e-4bdd-95c7-bd4b408d2812 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:28.746618 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7b0efe9a-454e-4bdd-95c7-bd4b408d2812 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:28.915584 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7b0efe9a-454e-4bdd-95c7-bd4b408d2812 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:28.923648 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7b0efe9a-454e-4bdd-95c7-bd4b408d2812 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.193132 May 09 04:28:28.924826 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 138/283] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:28 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:28.955772 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-229576f7-9578-478a-839c-32e147310f4f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:28.963021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-229576f7-9578-478a-839c-32e147310f4f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:28.963696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-229576f7-9578-478a-839c-32e147310f4f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:29.042290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-229576f7-9578-478a-839c-32e147310f4f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Going to try to stop instance {{(pid=117033) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 09 04:28:29.105582 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-229576f7-9578-478a-839c-32e147310f4f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "POST /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/action" status: 202 len: 0 microversion: 2.1 time: 0.153144 May 09 04:28:29.106903 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 146/284] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 04:28:28 2022] POST /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:28:29.118216 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-04590410-3b20-4e05-ab13-98877a460424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:29.118829 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-04590410-3b20-4e05-ab13-98877a460424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:29.125570 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04590410-3b20-4e05-ab13-98877a460424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:29.126198 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04590410-3b20-4e05-ab13-98877a460424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:29.127233 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04590410-3b20-4e05-ab13-98877a460424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:29.127824 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04590410-3b20-4e05-ab13-98877a460424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:29.165921 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-18fc8af7-9a77-47fe-b37b-1c62f9570ada tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:29.167372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-18fc8af7-9a77-47fe-b37b-1c62f9570ada tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:29.176127 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18fc8af7-9a77-47fe-b37b-1c62f9570ada tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:29.177624 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18fc8af7-9a77-47fe-b37b-1c62f9570ada tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:29.178764 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18fc8af7-9a77-47fe-b37b-1c62f9570ada tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:29.179433 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18fc8af7-9a77-47fe-b37b-1c62f9570ada tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:29.378802 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-04590410-3b20-4e05-ab13-98877a460424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:29.387360 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-04590410-3b20-4e05-ab13-98877a460424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.276335 May 09 04:28:29.392200 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 139/285] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:29 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:29.400739 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-646610c8-3569-482f-8072-f08ab3dfc96a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:29.401636 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-646610c8-3569-482f-8072-f08ab3dfc96a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:29.407953 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-646610c8-3569-482f-8072-f08ab3dfc96a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:29.408747 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-646610c8-3569-482f-8072-f08ab3dfc96a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:29.409751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-646610c8-3569-482f-8072-f08ab3dfc96a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:29.410422 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-646610c8-3569-482f-8072-f08ab3dfc96a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:29.459518 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-18fc8af7-9a77-47fe-b37b-1c62f9570ada tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:29.473238 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-18fc8af7-9a77-47fe-b37b-1c62f9570ada tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:29.476604 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-18fc8af7-9a77-47fe-b37b-1c62f9570ada tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:29.478160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-18fc8af7-9a77-47fe-b37b-1c62f9570ada tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.319063 May 09 04:28:29.479265 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 147/286] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:29 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:29.485164 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-bbd868c2-72e4-45cc-858a-e435157eaef0 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:29.486103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-bbd868c2-72e4-45cc-858a-e435157eaef0 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:29.493209 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bbd868c2-72e4-45cc-858a-e435157eaef0 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:29.493948 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bbd868c2-72e4-45cc-858a-e435157eaef0 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:29.495105 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bbd868c2-72e4-45cc-858a-e435157eaef0 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:29.495767 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bbd868c2-72e4-45cc-858a-e435157eaef0 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:29.621809 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-646610c8-3569-482f-8072-f08ab3dfc96a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:29.632952 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-646610c8-3569-482f-8072-f08ab3dfc96a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.239394 May 09 04:28:29.633990 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 140/287] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:29 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:29.678581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-bbd868c2-72e4-45cc-858a-e435157eaef0 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:29.685800 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-bbd868c2-72e4-45cc-858a-e435157eaef0 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1366 microversion: 2.1 time: 0.204611 May 09 04:28:29.686372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 148/288] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:29 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:29.941536 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2b3b4a2f-c66e-431f-960c-5201da45347b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:29.943193 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2b3b4a2f-c66e-431f-960c-5201da45347b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:29.950019 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b3b4a2f-c66e-431f-960c-5201da45347b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:29.950989 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b3b4a2f-c66e-431f-960c-5201da45347b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:29.952153 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b3b4a2f-c66e-431f-960c-5201da45347b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:29.952743 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b3b4a2f-c66e-431f-960c-5201da45347b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:30.149743 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2b3b4a2f-c66e-431f-960c-5201da45347b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:30.158155 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2b3b4a2f-c66e-431f-960c-5201da45347b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.220966 May 09 04:28:30.159270 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 141/289] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:29 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:30.409168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-bae08948-6ada-44bc-b5b7-6f34d5245181 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:30.410033 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-bae08948-6ada-44bc-b5b7-6f34d5245181 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:30.416901 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bae08948-6ada-44bc-b5b7-6f34d5245181 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:30.417343 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bae08948-6ada-44bc-b5b7-6f34d5245181 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:30.418116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bae08948-6ada-44bc-b5b7-6f34d5245181 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:30.418544 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bae08948-6ada-44bc-b5b7-6f34d5245181 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:30.498662 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-263d6b4b-48f6-4d9a-ad98-a83df042ec97 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:30.499856 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-263d6b4b-48f6-4d9a-ad98-a83df042ec97 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:30.506488 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-263d6b4b-48f6-4d9a-ad98-a83df042ec97 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:30.506932 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-263d6b4b-48f6-4d9a-ad98-a83df042ec97 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:30.507701 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-263d6b4b-48f6-4d9a-ad98-a83df042ec97 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:30.510598 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-263d6b4b-48f6-4d9a-ad98-a83df042ec97 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:30.568545 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-bae08948-6ada-44bc-b5b7-6f34d5245181 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:30.583861 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-bae08948-6ada-44bc-b5b7-6f34d5245181 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.177956 May 09 04:28:30.584628 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 149/290] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:30 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:30.653505 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-354b7912-c257-46c3-8a67-d25aaf76aae2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:30.654292 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-354b7912-c257-46c3-8a67-d25aaf76aae2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:30.656951 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-263d6b4b-48f6-4d9a-ad98-a83df042ec97 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:30.660629 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-354b7912-c257-46c3-8a67-d25aaf76aae2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:30.661462 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-354b7912-c257-46c3-8a67-d25aaf76aae2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:30.662354 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-354b7912-c257-46c3-8a67-d25aaf76aae2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:30.662912 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-354b7912-c257-46c3-8a67-d25aaf76aae2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:30.665025 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-263d6b4b-48f6-4d9a-ad98-a83df042ec97 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:30.668766 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-263d6b4b-48f6-4d9a-ad98-a83df042ec97 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:30.668766 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-263d6b4b-48f6-4d9a-ad98-a83df042ec97 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.173028 May 09 04:28:30.672262 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 142/291] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:30 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:28:30.704054 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-66a5f02f-21bc-4249-843c-53bb71c8bba1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:30.704998 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-66a5f02f-21bc-4249-843c-53bb71c8bba1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:30.731266 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-66a5f02f-21bc-4249-843c-53bb71c8bba1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:30.732001 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-66a5f02f-21bc-4249-843c-53bb71c8bba1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:30.732928 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-66a5f02f-21bc-4249-843c-53bb71c8bba1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:30.733508 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-66a5f02f-21bc-4249-843c-53bb71c8bba1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:30.850496 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-354b7912-c257-46c3-8a67-d25aaf76aae2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:30.858905 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-354b7912-c257-46c3-8a67-d25aaf76aae2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.212136 May 09 04:28:30.870306 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 150/292] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:30 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:30.920708 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-66a5f02f-21bc-4249-843c-53bb71c8bba1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:30.927205 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-66a5f02f-21bc-4249-843c-53bb71c8bba1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1366 microversion: 2.1 time: 0.227479 May 09 04:28:30.928303 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 143/293] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:30 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:31.180458 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-9ee8f2e0-e736-4563-a802-9fdf2b2923da tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:31.181002 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-9ee8f2e0-e736-4563-a802-9fdf2b2923da tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:31.188050 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9ee8f2e0-e736-4563-a802-9fdf2b2923da tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:31.188501 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9ee8f2e0-e736-4563-a802-9fdf2b2923da tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:31.189284 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9ee8f2e0-e736-4563-a802-9fdf2b2923da tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:31.189716 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9ee8f2e0-e736-4563-a802-9fdf2b2923da tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:31.334052 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9ee8f2e0-e736-4563-a802-9fdf2b2923da tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:31.342552 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-9ee8f2e0-e736-4563-a802-9fdf2b2923da tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.170205 May 09 04:28:31.343352 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 151/294] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:31 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:31.602621 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-77d17dd1-a7a0-40a4-bc25-cf3ba8ffed71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:31.603226 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-77d17dd1-a7a0-40a4-bc25-cf3ba8ffed71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:31.609993 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-77d17dd1-a7a0-40a4-bc25-cf3ba8ffed71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:31.610585 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-77d17dd1-a7a0-40a4-bc25-cf3ba8ffed71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:31.611355 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-77d17dd1-a7a0-40a4-bc25-cf3ba8ffed71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:31.611791 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-77d17dd1-a7a0-40a4-bc25-cf3ba8ffed71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:31.686585 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c1906d9b-80e9-459d-b3e6-f36b9c558e47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:31.687865 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c1906d9b-80e9-459d-b3e6-f36b9c558e47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:31.695407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c1906d9b-80e9-459d-b3e6-f36b9c558e47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:31.700028 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c1906d9b-80e9-459d-b3e6-f36b9c558e47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:31.701336 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c1906d9b-80e9-459d-b3e6-f36b9c558e47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:31.701840 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c1906d9b-80e9-459d-b3e6-f36b9c558e47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:31.781038 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-77d17dd1-a7a0-40a4-bc25-cf3ba8ffed71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:31.789755 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-77d17dd1-a7a0-40a4-bc25-cf3ba8ffed71 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.191638 May 09 04:28:31.799578 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 144/295] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:31 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:31.861977 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c1906d9b-80e9-459d-b3e6-f36b9c558e47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:31.872637 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c1906d9b-80e9-459d-b3e6-f36b9c558e47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:31.874151 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c1906d9b-80e9-459d-b3e6-f36b9c558e47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:31.875349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c1906d9b-80e9-459d-b3e6-f36b9c558e47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.192648 May 09 04:28:31.876411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 152/296] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:31 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:28:31.878915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f5587a43-0423-4c7d-8832-b3ca4a1221a5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:31.879705 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f5587a43-0423-4c7d-8832-b3ca4a1221a5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:31.881159 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-eb53a4fa-4722-4cdf-a687-671fdbaaaeea tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Action: 'create', calling method: .version_select at 0x7fbfd46e7940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-300254567"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:31.886534 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f5587a43-0423-4c7d-8832-b3ca4a1221a5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:31.887038 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f5587a43-0423-4c7d-8832-b3ca4a1221a5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:31.887830 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f5587a43-0423-4c7d-8832-b3ca4a1221a5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:31.888486 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f5587a43-0423-4c7d-8832-b3ca4a1221a5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:31.895017 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-eb53a4fa-4722-4cdf-a687-671fdbaaaeea tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Getting quotas for project cf2a64ab3bc1448b8a934e2d103bb161. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:28:31.899512 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-eb53a4fa-4722-4cdf-a687-671fdbaaaeea tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Getting quotas for user 25e4c84bd2174040a20fa9c60ddb6b55 and project cf2a64ab3bc1448b8a934e2d103bb161. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:28:32.025180 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f5587a43-0423-4c7d-8832-b3ca4a1221a5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:32.033480 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f5587a43-0423-4c7d-8832-b3ca4a1221a5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.159405 May 09 04:28:32.034757 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 145/297] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:31 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:32.039587 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5534676e-df0a-43df-a402-8b6468d20a76 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:32.040315 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5534676e-df0a-43df-a402-8b6468d20a76 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:32.047002 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5534676e-df0a-43df-a402-8b6468d20a76 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:32.047002 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5534676e-df0a-43df-a402-8b6468d20a76 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:32.047633 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5534676e-df0a-43df-a402-8b6468d20a76 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:32.048105 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5534676e-df0a-43df-a402-8b6468d20a76 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:32.174622 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5534676e-df0a-43df-a402-8b6468d20a76 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:32.182514 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5534676e-df0a-43df-a402-8b6468d20a76 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1556 microversion: 2.1 time: 0.147297 May 09 04:28:32.183086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 146/298] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:32 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:32.187616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1875551248", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-901938689", "security_groups": [{"name": "tempest-secgroup-smoke-1544934256"}], "block_device_mapping_v2": [{"uuid": "009defab-9544-4bb4-9e68-bcc76ec37ad1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d0b894fb-ca2e-4f02-9d2e-0b887784e9ae"}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:32.293942 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] validate_networks() for [('d0b894fb-ca2e-4f02-9d2e-0b887784e9ae', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:28:32.551221 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-eb53a4fa-4722-4cdf-a687-671fdbaaaeea tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Getting quotas for project cf2a64ab3bc1448b8a934e2d103bb161. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:28:32.555641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-eb53a4fa-4722-4cdf-a687-671fdbaaaeea tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Getting quotas for user 25e4c84bd2174040a20fa9c60ddb6b55 and project cf2a64ab3bc1448b8a934e2d103bb161. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:28:32.569404 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-eb53a4fa-4722-4cdf-a687-671fdbaaaeea tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.691949 May 09 04:28:32.570284 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 153/299] 10.222.0.44 () {60 vars in 1157 bytes} [Mon May 9 04:28:31 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:32.577925 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1487f5b9-3b3b-4a0e-858b-d6a56ffc3a15 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:32.578444 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1487f5b9-3b3b-4a0e-858b-d6a56ffc3a15 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:32.585683 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1487f5b9-3b3b-4a0e-858b-d6a56ffc3a15 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:32.586172 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1487f5b9-3b3b-4a0e-858b-d6a56ffc3a15 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:32.587190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1487f5b9-3b3b-4a0e-858b-d6a56ffc3a15 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:32.587618 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1487f5b9-3b3b-4a0e-858b-d6a56ffc3a15 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:32.656943 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:28:32.657433 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:28:32.657806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:28:32.658208 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:28:32.658609 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:28:32.668721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:32.669164 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:32.669960 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:32.670394 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:32.680175 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1487f5b9-3b3b-4a0e-858b-d6a56ffc3a15 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108795 May 09 04:28:32.680867 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 154/300] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 04:28:32 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:28:32.685412 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-be349b31-c060-49af-8ca5-9aad9e481faf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:32.686087 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-be349b31-c060-49af-8ca5-9aad9e481faf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:32.687416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Getting quotas for project b6223852af9c4361b99a24e7a49a7734. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:28:32.691442 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Getting quotas for user cb34feb512764ec5b9ca25c30c3d7159 and project b6223852af9c4361b99a24e7a49a7734. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:28:32.693426 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-be349b31-c060-49af-8ca5-9aad9e481faf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:32.693880 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-be349b31-c060-49af-8ca5-9aad9e481faf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:32.694818 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-be349b31-c060-49af-8ca5-9aad9e481faf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:32.694932 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-be349b31-c060-49af-8ca5-9aad9e481faf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:32.753357 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:28:32.756094 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='009defab-9544-4bb4-9e68-bcc76ec37ad1',volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:28:32.882795 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ea952200-27eb-4ef9-acb2-135e3bb5f126 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.698677 May 09 04:28:32.883442 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 147/301] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:28:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:28:32.887972 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1307821970", "imageRef": "a5d4245d-11f8-467f-bf6b-b85af2108516", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-300254567", "networks": [{"uuid": "da1a742f-a0fb-4823-acf5-bb842d53e97e"}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:32.955593 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] validate_networks() for [('da1a742f-a0fb-4823-acf5-bb842d53e97e', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:28:32.973063 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-be349b31-c060-49af-8ca5-9aad9e481faf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:32.984526 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-be349b31-c060-49af-8ca5-9aad9e481faf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.301986 May 09 04:28:32.985106 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 155/302] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:32 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:32.991414 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-422be397-f7df-4862-920b-c9bfc78a3a9e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:32.992632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-422be397-f7df-4862-920b-c9bfc78a3a9e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:33.000807 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-422be397-f7df-4862-920b-c9bfc78a3a9e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:33.001254 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-422be397-f7df-4862-920b-c9bfc78a3a9e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:33.002063 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-422be397-f7df-4862-920b-c9bfc78a3a9e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:33.002498 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-422be397-f7df-4862-920b-c9bfc78a3a9e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:33.278125 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-422be397-f7df-4862-920b-c9bfc78a3a9e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:33.289688 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-422be397-f7df-4862-920b-c9bfc78a3a9e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.303341 May 09 04:28:33.290874 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 156/303] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:32 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:33.297917 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5c798bdb-2a32-4ff6-a9a2-f4ae5cfea091 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:33.298732 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5c798bdb-2a32-4ff6-a9a2-f4ae5cfea091 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:33.305509 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5c798bdb-2a32-4ff6-a9a2-f4ae5cfea091 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:33.305987 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5c798bdb-2a32-4ff6-a9a2-f4ae5cfea091 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:33.306893 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5c798bdb-2a32-4ff6-a9a2-f4ae5cfea091 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:33.307202 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5c798bdb-2a32-4ff6-a9a2-f4ae5cfea091 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:33.418737 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:28:33.419123 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:28:33.419618 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:28:33.420061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:28:33.420614 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:28:33.431003 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:33.436864 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:33.437973 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:33.438491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:33.461156 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Getting quotas for project cf2a64ab3bc1448b8a934e2d103bb161. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:28:33.465851 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Getting quotas for user 25e4c84bd2174040a20fa9c60ddb6b55 and project cf2a64ab3bc1448b8a934e2d103bb161. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:28:33.478445 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:28:33.480577 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5d4245d-11f8-467f-bf6b-b85af2108516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:28:33.530107 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-04835db6-18e9-48c7-8d01-03501db95b33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645363 May 09 04:28:33.537516 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 148/304] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:28:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:28:33.541658 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cc81b8ca-e6d8-4c59-a410-a0911229171d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:33.543396 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-cc81b8ca-e6d8-4c59-a410-a0911229171d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:33.549983 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cc81b8ca-e6d8-4c59-a410-a0911229171d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:33.552315 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cc81b8ca-e6d8-4c59-a410-a0911229171d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:33.553920 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cc81b8ca-e6d8-4c59-a410-a0911229171d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:33.554567 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cc81b8ca-e6d8-4c59-a410-a0911229171d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:33.631784 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-cc81b8ca-e6d8-4c59-a410-a0911229171d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:33.643505 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-cc81b8ca-e6d8-4c59-a410-a0911229171d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1136 microversion: 2.1 time: 0.108354 May 09 04:28:33.644414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 149/305] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:33 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1136 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:33.649385 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-58a2b2ca-17d4-4b8d-928b-7937b6435063 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:33.649987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-58a2b2ca-17d4-4b8d-928b-7937b6435063 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:33.656206 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58a2b2ca-17d4-4b8d-928b-7937b6435063 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:33.656660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58a2b2ca-17d4-4b8d-928b-7937b6435063 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:33.657481 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58a2b2ca-17d4-4b8d-928b-7937b6435063 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:33.658040 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58a2b2ca-17d4-4b8d-928b-7937b6435063 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:33.820047 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-58a2b2ca-17d4-4b8d-928b-7937b6435063 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:33.828007 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-58a2b2ca-17d4-4b8d-928b-7937b6435063 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.182280 May 09 04:28:33.834943 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 150/306] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:33 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:33.835279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5c798bdb-2a32-4ff6-a9a2-f4ae5cfea091 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:33.835741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d0f152d8-448c-4530-a315-f9809aed192e tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:33.835741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d0f152d8-448c-4530-a315-f9809aed192e tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:33.842412 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5c798bdb-2a32-4ff6-a9a2-f4ae5cfea091 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:33.849677 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5c798bdb-2a32-4ff6-a9a2-f4ae5cfea091 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:33.851131 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5c798bdb-2a32-4ff6-a9a2-f4ae5cfea091 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.558758 May 09 04:28:33.853008 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 157/307] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:33 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:33.906987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d0f152d8-448c-4530-a315-f9809aed192e tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:33.914929 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d0f152d8-448c-4530-a315-f9809aed192e tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1258 microversion: 2.1 time: 0.084918 May 09 04:28:33.915562 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 151/308] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:33 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:34.002443 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-071ffbe9-5683-4e1b-b764-571783fe61c2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:34.003619 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-071ffbe9-5683-4e1b-b764-571783fe61c2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:34.012863 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-071ffbe9-5683-4e1b-b764-571783fe61c2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:34.013475 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-071ffbe9-5683-4e1b-b764-571783fe61c2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:34.014583 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-071ffbe9-5683-4e1b-b764-571783fe61c2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:34.015094 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-071ffbe9-5683-4e1b-b764-571783fe61c2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:34.222033 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-071ffbe9-5683-4e1b-b764-571783fe61c2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:34.233742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-071ffbe9-5683-4e1b-b764-571783fe61c2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.235719 May 09 04:28:34.234517 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 158/309] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:33 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:34.307327 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c7832618-97e1-424c-8ab1-0323ccd52942 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:34.308308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c7832618-97e1-424c-8ab1-0323ccd52942 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:34.315189 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c7832618-97e1-424c-8ab1-0323ccd52942 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:34.315753 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c7832618-97e1-424c-8ab1-0323ccd52942 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:34.316652 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c7832618-97e1-424c-8ab1-0323ccd52942 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:34.317156 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c7832618-97e1-424c-8ab1-0323ccd52942 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:34.407745 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-64e5c1d7-0ce6-4cef-9ed3-9cff0ffa1a4a req-85ab34ca-afd4-4558-b006-dcfab53080cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48735dde-9de8-4b71-877f-e86789f4c887", "tag": "1e27a9e1-6f10-43bb-909c-aa9fc82bc83c"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:34.417982 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-64e5c1d7-0ce6-4cef-9ed3-9cff0ffa1a4a req-85ab34ca-afd4-4558-b006-dcfab53080cc service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:34.418489 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-64e5c1d7-0ce6-4cef-9ed3-9cff0ffa1a4a req-85ab34ca-afd4-4558-b006-dcfab53080cc service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:34.432563 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-64e5c1d7-0ce6-4cef-9ed3-9cff0ffa1a4a req-85ab34ca-afd4-4558-b006-dcfab53080cc service nova] Creating event network-changed:1e27a9e1-6f10-43bb-909c-aa9fc82bc83c for instance 48735dde-9de8-4b71-877f-e86789f4c887 on hv-cinder-83800 May 09 04:28:34.439171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-64e5c1d7-0ce6-4cef-9ed3-9cff0ffa1a4a req-85ab34ca-afd4-4558-b006-dcfab53080cc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035780 May 09 04:28:34.440650 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 159/310] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:28:34.527031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c7832618-97e1-424c-8ab1-0323ccd52942 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:34.535814 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c7832618-97e1-424c-8ab1-0323ccd52942 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.232420 May 09 04:28:34.546260 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 152/311] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:34 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:34.660810 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e224b9e0-c9b2-4db5-9095-06bea327474b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:34.662685 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e224b9e0-c9b2-4db5-9095-06bea327474b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:34.669385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e224b9e0-c9b2-4db5-9095-06bea327474b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:34.673902 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e224b9e0-c9b2-4db5-9095-06bea327474b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:34.676899 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e224b9e0-c9b2-4db5-9095-06bea327474b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:34.677445 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e224b9e0-c9b2-4db5-9095-06bea327474b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:34.779005 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e224b9e0-c9b2-4db5-9095-06bea327474b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:34.794001 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e224b9e0-c9b2-4db5-9095-06bea327474b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1210 microversion: 2.1 time: 0.137205 May 09 04:28:34.799015 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 160/312] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:34 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1210 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:34.845087 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6ac013a5-5716-41c8-9334-08fadaf030d5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:34.845700 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6ac013a5-5716-41c8-9334-08fadaf030d5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:34.870653 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6ac013a5-5716-41c8-9334-08fadaf030d5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:34.872198 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6ac013a5-5716-41c8-9334-08fadaf030d5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:34.873488 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6ac013a5-5716-41c8-9334-08fadaf030d5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:34.874224 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6ac013a5-5716-41c8-9334-08fadaf030d5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:34.874381 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f57bbe79-1938-4945-bee0-4422dda90257 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:34.875666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f57bbe79-1938-4945-bee0-4422dda90257 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:34.890689 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f57bbe79-1938-4945-bee0-4422dda90257 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:34.891053 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f57bbe79-1938-4945-bee0-4422dda90257 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:34.894666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f57bbe79-1938-4945-bee0-4422dda90257 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:34.904657 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f57bbe79-1938-4945-bee0-4422dda90257 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:35.163279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f57bbe79-1938-4945-bee0-4422dda90257 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:35.174176 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f57bbe79-1938-4945-bee0-4422dda90257 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:35.175871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f57bbe79-1938-4945-bee0-4422dda90257 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:35.180370 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f57bbe79-1938-4945-bee0-4422dda90257 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.308902 May 09 04:28:35.192353 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 161/313] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:34 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:28:35.199415 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-7ff62d33-9167-4ebe-a2c2-b046f4cef361 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:35.202750 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-7ff62d33-9167-4ebe-a2c2-b046f4cef361 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:35.216149 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7ff62d33-9167-4ebe-a2c2-b046f4cef361 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:35.219422 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7ff62d33-9167-4ebe-a2c2-b046f4cef361 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:35.221236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7ff62d33-9167-4ebe-a2c2-b046f4cef361 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:35.221819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7ff62d33-9167-4ebe-a2c2-b046f4cef361 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:35.348408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-7ff62d33-9167-4ebe-a2c2-b046f4cef361 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:35.360319 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-7ff62d33-9167-4ebe-a2c2-b046f4cef361 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1316 microversion: 2.1 time: 0.166401 May 09 04:28:35.360921 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 162/314] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:35 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:35.377453 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ccbedf94-1f02-4e3f-b10e-957319f9334d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:35.378093 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ccbedf94-1f02-4e3f-b10e-957319f9334d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:35.391705 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ccbedf94-1f02-4e3f-b10e-957319f9334d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:35.392182 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ccbedf94-1f02-4e3f-b10e-957319f9334d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:35.392963 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ccbedf94-1f02-4e3f-b10e-957319f9334d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:35.393393 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ccbedf94-1f02-4e3f-b10e-957319f9334d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:35.530494 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6ac013a5-5716-41c8-9334-08fadaf030d5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:35.555552 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6ac013a5-5716-41c8-9334-08fadaf030d5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.714177 May 09 04:28:35.573124 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 153/315] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:34 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:35.592834 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9c8fbbc0-64ee-4e36-bd05-552da873e51a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:35.595328 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9c8fbbc0-64ee-4e36-bd05-552da873e51a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:35.607516 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c8fbbc0-64ee-4e36-bd05-552da873e51a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:35.608008 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c8fbbc0-64ee-4e36-bd05-552da873e51a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:35.608787 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c8fbbc0-64ee-4e36-bd05-552da873e51a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:35.609559 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c8fbbc0-64ee-4e36-bd05-552da873e51a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:35.987697 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ccbedf94-1f02-4e3f-b10e-957319f9334d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:35.998966 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ccbedf94-1f02-4e3f-b10e-957319f9334d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.636986 May 09 04:28:36.010527 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 163/316] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:35 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:36.023085 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-31cb2fc1-bb52-440a-b4f3-7e3e4fe4e158 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:36.023706 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-31cb2fc1-bb52-440a-b4f3-7e3e4fe4e158 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:36.042872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-31cb2fc1-bb52-440a-b4f3-7e3e4fe4e158 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:36.043331 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-31cb2fc1-bb52-440a-b4f3-7e3e4fe4e158 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:36.048270 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-31cb2fc1-bb52-440a-b4f3-7e3e4fe4e158 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:36.048778 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-31cb2fc1-bb52-440a-b4f3-7e3e4fe4e158 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:36.281344 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-31cb2fc1-bb52-440a-b4f3-7e3e4fe4e158 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:36.290000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-31cb2fc1-bb52-440a-b4f3-7e3e4fe4e158 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.277861 May 09 04:28:36.290574 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 164/317] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:36 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:36.297849 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-39828548-b3ae-4249-a57f-997b6f0386cb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:36.298538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-39828548-b3ae-4249-a57f-997b6f0386cb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:36.312692 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-39828548-b3ae-4249-a57f-997b6f0386cb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:36.313124 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-39828548-b3ae-4249-a57f-997b6f0386cb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:36.313907 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-39828548-b3ae-4249-a57f-997b6f0386cb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:36.314519 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-39828548-b3ae-4249-a57f-997b6f0386cb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:36.527880 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9c8fbbc0-64ee-4e36-bd05-552da873e51a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:36.541972 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9c8fbbc0-64ee-4e36-bd05-552da873e51a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.963924 May 09 04:28:36.542631 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 154/318] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:35 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:36.553800 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-222d19c6-b64b-4d73-9d31-3432b98fa59b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:36.557135 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-222d19c6-b64b-4d73-9d31-3432b98fa59b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:36.571012 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-222d19c6-b64b-4d73-9d31-3432b98fa59b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:36.571466 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-222d19c6-b64b-4d73-9d31-3432b98fa59b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:36.572289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-222d19c6-b64b-4d73-9d31-3432b98fa59b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:36.572733 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-222d19c6-b64b-4d73-9d31-3432b98fa59b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:36.664787 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-39828548-b3ae-4249-a57f-997b6f0386cb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:36.674414 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-39828548-b3ae-4249-a57f-997b6f0386cb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:36.678300 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-39828548-b3ae-4249-a57f-997b6f0386cb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:36.680581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-39828548-b3ae-4249-a57f-997b6f0386cb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.388569 May 09 04:28:36.681436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 165/319] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:36 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:36.686777 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ca8f76d8-9b0e-4431-a101-222ee8224274 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:36.687741 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ca8f76d8-9b0e-4431-a101-222ee8224274 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:36.695418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ca8f76d8-9b0e-4431-a101-222ee8224274 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:36.696270 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ca8f76d8-9b0e-4431-a101-222ee8224274 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:36.697285 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ca8f76d8-9b0e-4431-a101-222ee8224274 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:36.697965 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ca8f76d8-9b0e-4431-a101-222ee8224274 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:36.928500 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ca8f76d8-9b0e-4431-a101-222ee8224274 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:36.942473 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ca8f76d8-9b0e-4431-a101-222ee8224274 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.259632 May 09 04:28:36.952713 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 166/320] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:36 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:37.017617 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-40b557d6-3af0-4204-b467-c0f14c54e49c tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:37.019170 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-40b557d6-3af0-4204-b467-c0f14c54e49c tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:37.032002 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-40b557d6-3af0-4204-b467-c0f14c54e49c tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:37.034145 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-40b557d6-3af0-4204-b467-c0f14c54e49c tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:37.035180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-40b557d6-3af0-4204-b467-c0f14c54e49c tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:37.037212 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-40b557d6-3af0-4204-b467-c0f14c54e49c tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:37.142664 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-222d19c6-b64b-4d73-9d31-3432b98fa59b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:37.156602 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-222d19c6-b64b-4d73-9d31-3432b98fa59b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.607588 May 09 04:28:37.157462 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 155/321] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:36 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:37.315792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4b9b4810-d600-44f2-bbd7-904bd86691d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:37.319546 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4b9b4810-d600-44f2-bbd7-904bd86691d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:37.330710 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4b9b4810-d600-44f2-bbd7-904bd86691d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:37.332056 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4b9b4810-d600-44f2-bbd7-904bd86691d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:37.335035 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-40b557d6-3af0-4204-b467-c0f14c54e49c tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:37.336952 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4b9b4810-d600-44f2-bbd7-904bd86691d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:37.340674 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4b9b4810-d600-44f2-bbd7-904bd86691d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:37.343043 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-40b557d6-3af0-4204-b467-c0f14c54e49c tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.330416 May 09 04:28:37.354450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 167/322] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:37 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:37.486870 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-ff03f041-b239-460b-af25-e82c24f08019 req-a852d513-1dd1-4a9c-b438-557dbb9417e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25d4ade-5644-40c6-81ca-73ccc85df6e1", "tag": "f61a276d-0cef-4028-b9cc-fe9fb05d4f49"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:37.512583 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-ff03f041-b239-460b-af25-e82c24f08019 req-a852d513-1dd1-4a9c-b438-557dbb9417e2 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:37.515119 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-ff03f041-b239-460b-af25-e82c24f08019 req-a852d513-1dd1-4a9c-b438-557dbb9417e2 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:37.543357 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-ff03f041-b239-460b-af25-e82c24f08019 req-a852d513-1dd1-4a9c-b438-557dbb9417e2 service nova] Creating event network-changed:f61a276d-0cef-4028-b9cc-fe9fb05d4f49 for instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 on hv-cinder-83800 May 09 04:28:37.550388 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-ff03f041-b239-460b-af25-e82c24f08019 req-a852d513-1dd1-4a9c-b438-557dbb9417e2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067458 May 09 04:28:37.552670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 168/323] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:28:37.579408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d1cd9bbc-f644-41c5-93f8-a057020cc18f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:37.580170 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d1cd9bbc-f644-41c5-93f8-a057020cc18f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:37.605870 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d1cd9bbc-f644-41c5-93f8-a057020cc18f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:37.606111 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d1cd9bbc-f644-41c5-93f8-a057020cc18f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:37.606809 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d1cd9bbc-f644-41c5-93f8-a057020cc18f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:37.616527 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d1cd9bbc-f644-41c5-93f8-a057020cc18f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:37.647529 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4b9b4810-d600-44f2-bbd7-904bd86691d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:37.657647 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4b9b4810-d600-44f2-bbd7-904bd86691d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.351124 May 09 04:28:37.658931 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 156/324] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:37 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:37.678506 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-01193ab0-a21e-4cd1-88a8-504311682171 req-04186b31-e9b2-4977-aa35-bf56cda68484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a541a008-c541-407b-8868-a2b9d98ed15d", "name": "network-vif-plugged", "status": "completed", "tag": "8b3c8f68-461e-4b7f-843a-747af41739b1"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:37.700609 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-01193ab0-a21e-4cd1-88a8-504311682171 req-04186b31-e9b2-4977-aa35-bf56cda68484 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:37.703143 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-01193ab0-a21e-4cd1-88a8-504311682171 req-04186b31-e9b2-4977-aa35-bf56cda68484 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:37.726730 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-01193ab0-a21e-4cd1-88a8-504311682171 req-04186b31-e9b2-4977-aa35-bf56cda68484 service nova] Creating event network-vif-plugged:8b3c8f68-461e-4b7f-843a-747af41739b1 for instance a541a008-c541-407b-8868-a2b9d98ed15d on hv-cinder-83800 May 09 04:28:37.737782 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-01193ab0-a21e-4cd1-88a8-504311682171 req-04186b31-e9b2-4977-aa35-bf56cda68484 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067210 May 09 04:28:37.743782 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 157/325] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:28:37.757376 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-efc34478-784e-45a9-b1ae-b10aaa984e86 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:37.758624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-efc34478-784e-45a9-b1ae-b10aaa984e86 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:37.767229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-efc34478-784e-45a9-b1ae-b10aaa984e86 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:37.768092 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-efc34478-784e-45a9-b1ae-b10aaa984e86 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:37.769165 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-efc34478-784e-45a9-b1ae-b10aaa984e86 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:37.769912 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-efc34478-784e-45a9-b1ae-b10aaa984e86 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:37.877369 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d1cd9bbc-f644-41c5-93f8-a057020cc18f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:37.888034 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d1cd9bbc-f644-41c5-93f8-a057020cc18f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.330393 May 09 04:28:37.888803 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 169/326] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:37 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:37.943303 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-efc34478-784e-45a9-b1ae-b10aaa984e86 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:37.951431 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-efc34478-784e-45a9-b1ae-b10aaa984e86 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:37.952961 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-efc34478-784e-45a9-b1ae-b10aaa984e86 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:37.954112 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-efc34478-784e-45a9-b1ae-b10aaa984e86 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.208056 May 09 04:28:37.962108 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 158/327] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:37 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:37.970569 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-95ec19d1-36bf-4476-902c-333f56ffb5fe tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:37.971448 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-95ec19d1-36bf-4476-902c-333f56ffb5fe tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:37.979165 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-95ec19d1-36bf-4476-902c-333f56ffb5fe tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:37.979617 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-95ec19d1-36bf-4476-902c-333f56ffb5fe tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:37.980425 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-95ec19d1-36bf-4476-902c-333f56ffb5fe tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:37.980860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-95ec19d1-36bf-4476-902c-333f56ffb5fe tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:38.115835 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-95ec19d1-36bf-4476-902c-333f56ffb5fe tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:38.123810 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-95ec19d1-36bf-4476-902c-333f56ffb5fe tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.157662 May 09 04:28:38.124426 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 170/328] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:37 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:38.174600 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-75586f75-86ca-4a68-b247-30dc27dbd8b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:38.175210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-75586f75-86ca-4a68-b247-30dc27dbd8b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:38.182236 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75586f75-86ca-4a68-b247-30dc27dbd8b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:38.182683 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75586f75-86ca-4a68-b247-30dc27dbd8b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:38.183451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75586f75-86ca-4a68-b247-30dc27dbd8b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:38.183884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75586f75-86ca-4a68-b247-30dc27dbd8b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:38.324939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-75586f75-86ca-4a68-b247-30dc27dbd8b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:38.336273 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-75586f75-86ca-4a68-b247-30dc27dbd8b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.165515 May 09 04:28:38.337108 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 159/329] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:38 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:38.360783 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-0866fd79-3a11-45c2-bccd-6248c208de29 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:38.361538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-0866fd79-3a11-45c2-bccd-6248c208de29 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:38.368961 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0866fd79-3a11-45c2-bccd-6248c208de29 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:38.369454 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0866fd79-3a11-45c2-bccd-6248c208de29 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:38.370262 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0866fd79-3a11-45c2-bccd-6248c208de29 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:38.370694 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0866fd79-3a11-45c2-bccd-6248c208de29 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:38.515504 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-0866fd79-3a11-45c2-bccd-6248c208de29 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:38.526851 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-0866fd79-3a11-45c2-bccd-6248c208de29 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.169644 May 09 04:28:38.527980 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 171/330] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:38 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:38.676823 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f122c255-1b58-421c-8e4c-075f2075173d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:38.677382 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f122c255-1b58-421c-8e4c-075f2075173d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:38.683517 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f122c255-1b58-421c-8e4c-075f2075173d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:38.683981 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f122c255-1b58-421c-8e4c-075f2075173d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:38.684748 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f122c255-1b58-421c-8e4c-075f2075173d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:38.685176 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f122c255-1b58-421c-8e4c-075f2075173d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:38.826195 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f122c255-1b58-421c-8e4c-075f2075173d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:38.840040 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f122c255-1b58-421c-8e4c-075f2075173d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.167017 May 09 04:28:38.841168 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 160/331] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:38 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:38.912780 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5f4e8e7b-71ff-457f-ac5d-1c16133aa74e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:38.913512 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5f4e8e7b-71ff-457f-ac5d-1c16133aa74e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:38.919597 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5f4e8e7b-71ff-457f-ac5d-1c16133aa74e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:38.920096 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5f4e8e7b-71ff-457f-ac5d-1c16133aa74e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:38.920880 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5f4e8e7b-71ff-457f-ac5d-1c16133aa74e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:38.921319 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5f4e8e7b-71ff-457f-ac5d-1c16133aa74e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:38.974504 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f47d6baf-6112-4a16-b4d6-04cd3b493dd0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:38.975149 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f47d6baf-6112-4a16-b4d6-04cd3b493dd0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:38.995779 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f47d6baf-6112-4a16-b4d6-04cd3b493dd0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:38.996270 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f47d6baf-6112-4a16-b4d6-04cd3b493dd0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:38.997062 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f47d6baf-6112-4a16-b4d6-04cd3b493dd0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:38.997499 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f47d6baf-6112-4a16-b4d6-04cd3b493dd0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:39.080362 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5f4e8e7b-71ff-457f-ac5d-1c16133aa74e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:39.093971 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5f4e8e7b-71ff-457f-ac5d-1c16133aa74e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.186140 May 09 04:28:39.102036 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 172/332] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:38 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:39.143175 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-06b58d8c-a4ff-4181-8ff7-898502922d74 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:39.144896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-06b58d8c-a4ff-4181-8ff7-898502922d74 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:39.152249 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-06b58d8c-a4ff-4181-8ff7-898502922d74 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:39.152918 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-06b58d8c-a4ff-4181-8ff7-898502922d74 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:39.153162 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f47d6baf-6112-4a16-b4d6-04cd3b493dd0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:39.153706 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-06b58d8c-a4ff-4181-8ff7-898502922d74 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:39.154136 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-06b58d8c-a4ff-4181-8ff7-898502922d74 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:39.163369 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f47d6baf-6112-4a16-b4d6-04cd3b493dd0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:39.164905 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f47d6baf-6112-4a16-b4d6-04cd3b493dd0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:39.166155 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f47d6baf-6112-4a16-b4d6-04cd3b493dd0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.196071 May 09 04:28:39.167939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 161/333] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:38 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:39.308823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-06b58d8c-a4ff-4181-8ff7-898502922d74 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:39.318704 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-06b58d8c-a4ff-4181-8ff7-898502922d74 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.180323 May 09 04:28:39.319290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 173/334] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:39 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:39.353695 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0c6fb831-791d-419a-b470-517851b58fda tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:39.354310 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0c6fb831-791d-419a-b470-517851b58fda tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:39.360734 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c6fb831-791d-419a-b470-517851b58fda tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:39.361182 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c6fb831-791d-419a-b470-517851b58fda tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:39.361957 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c6fb831-791d-419a-b470-517851b58fda tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:39.362395 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c6fb831-791d-419a-b470-517851b58fda tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:39.500870 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0c6fb831-791d-419a-b470-517851b58fda tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:39.509163 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0c6fb831-791d-419a-b470-517851b58fda tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.159208 May 09 04:28:39.509934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 162/335] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:39 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:39.544734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-73f62ccd-577e-4d27-8abd-4f19a31563c1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:39.545523 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-73f62ccd-577e-4d27-8abd-4f19a31563c1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:39.552746 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-73f62ccd-577e-4d27-8abd-4f19a31563c1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:39.553292 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-73f62ccd-577e-4d27-8abd-4f19a31563c1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:39.554156 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-73f62ccd-577e-4d27-8abd-4f19a31563c1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:39.554683 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-73f62ccd-577e-4d27-8abd-4f19a31563c1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:39.694670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-73f62ccd-577e-4d27-8abd-4f19a31563c1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:39.702351 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-73f62ccd-577e-4d27-8abd-4f19a31563c1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.161424 May 09 04:28:39.703267 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 174/336] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:39 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:39.857869 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-36ca6829-f328-4ec5-8d67-618ebb730005 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:39.858750 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-36ca6829-f328-4ec5-8d67-618ebb730005 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:39.866191 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-36ca6829-f328-4ec5-8d67-618ebb730005 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:39.866632 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-36ca6829-f328-4ec5-8d67-618ebb730005 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:39.867582 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-36ca6829-f328-4ec5-8d67-618ebb730005 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:39.868081 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-36ca6829-f328-4ec5-8d67-618ebb730005 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:40.030487 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-36ca6829-f328-4ec5-8d67-618ebb730005 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:40.040099 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-36ca6829-f328-4ec5-8d67-618ebb730005 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.186137 May 09 04:28:40.040716 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 163/337] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:39 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:40.111674 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-414a07f5-f0ee-48aa-92da-f5b04e3b5ac0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:40.112332 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-414a07f5-f0ee-48aa-92da-f5b04e3b5ac0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:40.119616 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-414a07f5-f0ee-48aa-92da-f5b04e3b5ac0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:40.120385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-414a07f5-f0ee-48aa-92da-f5b04e3b5ac0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:40.121147 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-414a07f5-f0ee-48aa-92da-f5b04e3b5ac0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:40.121577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-414a07f5-f0ee-48aa-92da-f5b04e3b5ac0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:40.184821 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-99503d44-f90a-4d26-b373-eae9fe8cae8a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:40.185435 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-99503d44-f90a-4d26-b373-eae9fe8cae8a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:40.191995 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-99503d44-f90a-4d26-b373-eae9fe8cae8a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:40.193088 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-99503d44-f90a-4d26-b373-eae9fe8cae8a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:40.193870 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-99503d44-f90a-4d26-b373-eae9fe8cae8a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:40.194310 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-99503d44-f90a-4d26-b373-eae9fe8cae8a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:40.269354 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-414a07f5-f0ee-48aa-92da-f5b04e3b5ac0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:40.282494 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-414a07f5-f0ee-48aa-92da-f5b04e3b5ac0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.174510 May 09 04:28:40.283329 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 175/338] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:40 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:40.338816 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-05231dd7-014a-41a9-b1f9-ac776efd42e1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:40.339791 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-05231dd7-014a-41a9-b1f9-ac776efd42e1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:40.348649 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05231dd7-014a-41a9-b1f9-ac776efd42e1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:40.360905 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05231dd7-014a-41a9-b1f9-ac776efd42e1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:40.361803 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05231dd7-014a-41a9-b1f9-ac776efd42e1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:40.362255 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05231dd7-014a-41a9-b1f9-ac776efd42e1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:40.377758 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-99503d44-f90a-4d26-b373-eae9fe8cae8a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:40.386911 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-99503d44-f90a-4d26-b373-eae9fe8cae8a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:40.388429 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-99503d44-f90a-4d26-b373-eae9fe8cae8a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:40.389806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-99503d44-f90a-4d26-b373-eae9fe8cae8a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.208853 May 09 04:28:40.400320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 164/339] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:40 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:40.527256 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-43133fe6-f5aa-4e8e-866b-0a4d3298beac tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:40.527862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-43133fe6-f5aa-4e8e-866b-0a4d3298beac tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:40.535015 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43133fe6-f5aa-4e8e-866b-0a4d3298beac tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:40.535386 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43133fe6-f5aa-4e8e-866b-0a4d3298beac tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:40.537348 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43133fe6-f5aa-4e8e-866b-0a4d3298beac tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:40.537864 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43133fe6-f5aa-4e8e-866b-0a4d3298beac tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:40.543019 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-05231dd7-014a-41a9-b1f9-ac776efd42e1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:40.550750 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-05231dd7-014a-41a9-b1f9-ac776efd42e1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.217777 May 09 04:28:40.557136 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 176/340] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:40 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:40.671782 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-43133fe6-f5aa-4e8e-866b-0a4d3298beac tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:40.679993 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-43133fe6-f5aa-4e8e-866b-0a4d3298beac tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.156955 May 09 04:28:40.680579 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 165/341] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:40 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:40.719530 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a6c2117e-bd25-4c91-b265-568a189ffe0a tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:40.720311 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a6c2117e-bd25-4c91-b265-568a189ffe0a tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:40.727330 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6c2117e-bd25-4c91-b265-568a189ffe0a tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:40.727772 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6c2117e-bd25-4c91-b265-568a189ffe0a tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:40.728572 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6c2117e-bd25-4c91-b265-568a189ffe0a tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:40.729004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6c2117e-bd25-4c91-b265-568a189ffe0a tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:40.878576 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a6c2117e-bd25-4c91-b265-568a189ffe0a tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:40.886900 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a6c2117e-bd25-4c91-b265-568a189ffe0a tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.171019 May 09 04:28:40.896760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 177/342] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:40 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:41.057898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1337bb8c-0dce-4904-bb9d-fae6c21c5321 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:41.058648 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1337bb8c-0dce-4904-bb9d-fae6c21c5321 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:41.065457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1337bb8c-0dce-4904-bb9d-fae6c21c5321 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:41.065986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1337bb8c-0dce-4904-bb9d-fae6c21c5321 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:41.067003 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1337bb8c-0dce-4904-bb9d-fae6c21c5321 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:41.067595 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1337bb8c-0dce-4904-bb9d-fae6c21c5321 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:41.215884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1337bb8c-0dce-4904-bb9d-fae6c21c5321 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:41.223939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1337bb8c-0dce-4904-bb9d-fae6c21c5321 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.169482 May 09 04:28:41.224527 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 166/343] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:41 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:41.303856 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1cac69f1-42b8-4297-a750-06937e6b4478 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:41.304489 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1cac69f1-42b8-4297-a750-06937e6b4478 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:41.310639 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1cac69f1-42b8-4297-a750-06937e6b4478 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:41.311080 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1cac69f1-42b8-4297-a750-06937e6b4478 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:41.311849 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1cac69f1-42b8-4297-a750-06937e6b4478 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:41.312308 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1cac69f1-42b8-4297-a750-06937e6b4478 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:41.409951 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-305a55ff-afa8-43dc-87cb-6410578d9169 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:41.410838 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-305a55ff-afa8-43dc-87cb-6410578d9169 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:41.417569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-305a55ff-afa8-43dc-87cb-6410578d9169 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:41.418021 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-305a55ff-afa8-43dc-87cb-6410578d9169 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:41.418805 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-305a55ff-afa8-43dc-87cb-6410578d9169 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:41.419235 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-305a55ff-afa8-43dc-87cb-6410578d9169 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:41.460667 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1cac69f1-42b8-4297-a750-06937e6b4478 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:41.471417 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1cac69f1-42b8-4297-a750-06937e6b4478 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.170575 May 09 04:28:41.472071 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 178/344] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:41 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:41.565973 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-305a55ff-afa8-43dc-87cb-6410578d9169 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:41.569634 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-183718bb-431c-4a18-8679-bd5d42b73578 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:41.570486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-183718bb-431c-4a18-8679-bd5d42b73578 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:41.575768 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-305a55ff-afa8-43dc-87cb-6410578d9169 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:41.577450 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-305a55ff-afa8-43dc-87cb-6410578d9169 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:41.578728 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-305a55ff-afa8-43dc-87cb-6410578d9169 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.172886 May 09 04:28:41.582487 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-183718bb-431c-4a18-8679-bd5d42b73578 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:41.583751 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-183718bb-431c-4a18-8679-bd5d42b73578 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:41.584788 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-183718bb-431c-4a18-8679-bd5d42b73578 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:41.585623 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-183718bb-431c-4a18-8679-bd5d42b73578 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:41.591398 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 167/345] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:41 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:28:41.707531 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f3ea6557-ed51-43a7-8717-be8f8afb5e2a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:41.707531 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f3ea6557-ed51-43a7-8717-be8f8afb5e2a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:41.712872 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3ea6557-ed51-43a7-8717-be8f8afb5e2a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:41.713320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3ea6557-ed51-43a7-8717-be8f8afb5e2a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:41.714086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3ea6557-ed51-43a7-8717-be8f8afb5e2a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:41.714517 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3ea6557-ed51-43a7-8717-be8f8afb5e2a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:41.729327 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-183718bb-431c-4a18-8679-bd5d42b73578 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:41.741930 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-183718bb-431c-4a18-8679-bd5d42b73578 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.177235 May 09 04:28:41.742804 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 179/346] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:41 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:41.872046 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f3ea6557-ed51-43a7-8717-be8f8afb5e2a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:41.880578 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f3ea6557-ed51-43a7-8717-be8f8afb5e2a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.185688 May 09 04:28:41.881356 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 168/347] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:41 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:41.903991 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ddee7473-9bb6-4546-9532-03bd29f5a2e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:41.904522 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ddee7473-9bb6-4546-9532-03bd29f5a2e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:41.910807 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ddee7473-9bb6-4546-9532-03bd29f5a2e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:41.911332 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ddee7473-9bb6-4546-9532-03bd29f5a2e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:41.912226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ddee7473-9bb6-4546-9532-03bd29f5a2e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:41.912666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ddee7473-9bb6-4546-9532-03bd29f5a2e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:42.056305 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ddee7473-9bb6-4546-9532-03bd29f5a2e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:42.063793 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ddee7473-9bb6-4546-9532-03bd29f5a2e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.163727 May 09 04:28:42.064608 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 180/348] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:41 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:42.240140 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-09817c65-f2f6-4c11-a187-3176c59ca6f8 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:42.240731 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-09817c65-f2f6-4c11-a187-3176c59ca6f8 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:42.247192 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-09817c65-f2f6-4c11-a187-3176c59ca6f8 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:42.247566 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-09817c65-f2f6-4c11-a187-3176c59ca6f8 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:42.248365 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-09817c65-f2f6-4c11-a187-3176c59ca6f8 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:42.248795 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-09817c65-f2f6-4c11-a187-3176c59ca6f8 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:42.391381 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-09817c65-f2f6-4c11-a187-3176c59ca6f8 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:42.399599 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-09817c65-f2f6-4c11-a187-3176c59ca6f8 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.163701 May 09 04:28:42.400534 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 169/349] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:42 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:42.491108 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-67947979-4174-42d2-bb59-c95cfe8f66ed tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:42.491710 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-67947979-4174-42d2-bb59-c95cfe8f66ed tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:42.499085 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-67947979-4174-42d2-bb59-c95cfe8f66ed tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:42.499588 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-67947979-4174-42d2-bb59-c95cfe8f66ed tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:42.500503 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-67947979-4174-42d2-bb59-c95cfe8f66ed tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:42.501031 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-67947979-4174-42d2-bb59-c95cfe8f66ed tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:42.597912 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bca65cf6-8d74-40a5-802a-ab9131be2d87 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:42.598479 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-bca65cf6-8d74-40a5-802a-ab9131be2d87 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:42.612763 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bca65cf6-8d74-40a5-802a-ab9131be2d87 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:42.613456 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bca65cf6-8d74-40a5-802a-ab9131be2d87 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:42.614794 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bca65cf6-8d74-40a5-802a-ab9131be2d87 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:42.615393 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bca65cf6-8d74-40a5-802a-ab9131be2d87 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:42.646590 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-67947979-4174-42d2-bb59-c95cfe8f66ed tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:42.655036 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-67947979-4174-42d2-bb59-c95cfe8f66ed tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.168434 May 09 04:28:42.655959 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 181/350] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:42 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:42.759349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5f5abaa6-2506-483e-8a3d-cc1fbb158587 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:42.759888 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5f5abaa6-2506-483e-8a3d-cc1fbb158587 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:42.765945 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bca65cf6-8d74-40a5-802a-ab9131be2d87 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:42.766111 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5f5abaa6-2506-483e-8a3d-cc1fbb158587 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:42.766541 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5f5abaa6-2506-483e-8a3d-cc1fbb158587 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:42.767336 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5f5abaa6-2506-483e-8a3d-cc1fbb158587 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:42.767778 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5f5abaa6-2506-483e-8a3d-cc1fbb158587 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:42.775073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bca65cf6-8d74-40a5-802a-ab9131be2d87 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:42.776585 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bca65cf6-8d74-40a5-802a-ab9131be2d87 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:42.777735 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bca65cf6-8d74-40a5-802a-ab9131be2d87 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.183873 May 09 04:28:42.787266 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 170/351] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:42 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:28:42.896669 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ebfec212-2d58-46c5-a63d-2c2c145b7e09 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:42.897291 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ebfec212-2d58-46c5-a63d-2c2c145b7e09 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:42.903966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebfec212-2d58-46c5-a63d-2c2c145b7e09 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:42.904426 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebfec212-2d58-46c5-a63d-2c2c145b7e09 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:42.905216 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebfec212-2d58-46c5-a63d-2c2c145b7e09 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:42.905662 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebfec212-2d58-46c5-a63d-2c2c145b7e09 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:42.913550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5f5abaa6-2506-483e-8a3d-cc1fbb158587 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:42.920959 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5f5abaa6-2506-483e-8a3d-cc1fbb158587 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.166286 May 09 04:28:42.921892 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 182/352] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:42 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:43.055105 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ebfec212-2d58-46c5-a63d-2c2c145b7e09 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:43.062761 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ebfec212-2d58-46c5-a63d-2c2c145b7e09 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.169982 May 09 04:28:43.063448 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 171/353] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:42 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:43.081708 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f079400c-c9aa-4ea5-8f5c-67838421fbe4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:43.082467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f079400c-c9aa-4ea5-8f5c-67838421fbe4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:43.088967 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f079400c-c9aa-4ea5-8f5c-67838421fbe4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:43.089486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f079400c-c9aa-4ea5-8f5c-67838421fbe4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:43.090320 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f079400c-c9aa-4ea5-8f5c-67838421fbe4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:43.090820 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f079400c-c9aa-4ea5-8f5c-67838421fbe4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:43.237690 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f079400c-c9aa-4ea5-8f5c-67838421fbe4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:43.246499 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f079400c-c9aa-4ea5-8f5c-67838421fbe4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.168890 May 09 04:28:43.247396 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 183/354] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:43 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:43.417719 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c4ab02f3-15d4-45b1-970d-14bb2864bb49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:43.418295 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c4ab02f3-15d4-45b1-970d-14bb2864bb49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:43.424431 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4ab02f3-15d4-45b1-970d-14bb2864bb49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:43.424873 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4ab02f3-15d4-45b1-970d-14bb2864bb49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:43.425646 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4ab02f3-15d4-45b1-970d-14bb2864bb49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:43.426072 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4ab02f3-15d4-45b1-970d-14bb2864bb49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:43.569809 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c4ab02f3-15d4-45b1-970d-14bb2864bb49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:43.578162 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c4ab02f3-15d4-45b1-970d-14bb2864bb49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.164281 May 09 04:28:43.588961 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 172/355] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:43 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:43.672552 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c7998342-560a-48e9-a645-8c878e07f9ca tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:43.673191 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c7998342-560a-48e9-a645-8c878e07f9ca tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:43.680650 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c7998342-560a-48e9-a645-8c878e07f9ca tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:43.681231 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c7998342-560a-48e9-a645-8c878e07f9ca tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:43.682121 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c7998342-560a-48e9-a645-8c878e07f9ca tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:43.682628 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c7998342-560a-48e9-a645-8c878e07f9ca tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:43.796056 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9f554188-55ee-4ea3-b7ff-82790150aa4b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:43.796667 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9f554188-55ee-4ea3-b7ff-82790150aa4b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:43.804245 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9f554188-55ee-4ea3-b7ff-82790150aa4b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:43.804684 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9f554188-55ee-4ea3-b7ff-82790150aa4b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:43.805454 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9f554188-55ee-4ea3-b7ff-82790150aa4b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:43.805880 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9f554188-55ee-4ea3-b7ff-82790150aa4b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:43.830010 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c7998342-560a-48e9-a645-8c878e07f9ca tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:43.841362 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c7998342-560a-48e9-a645-8c878e07f9ca tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.172624 May 09 04:28:43.841939 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 184/356] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:43 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:43.939053 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-535ec169-fc97-4b7c-bfe8-ec9e18c426d9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:43.939576 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-535ec169-fc97-4b7c-bfe8-ec9e18c426d9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:43.946143 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-535ec169-fc97-4b7c-bfe8-ec9e18c426d9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:43.946585 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-535ec169-fc97-4b7c-bfe8-ec9e18c426d9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:43.947477 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-535ec169-fc97-4b7c-bfe8-ec9e18c426d9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:43.947924 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-535ec169-fc97-4b7c-bfe8-ec9e18c426d9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:43.960915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9f554188-55ee-4ea3-b7ff-82790150aa4b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:43.970445 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9f554188-55ee-4ea3-b7ff-82790150aa4b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:43.972015 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9f554188-55ee-4ea3-b7ff-82790150aa4b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:43.973265 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9f554188-55ee-4ea3-b7ff-82790150aa4b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.181118 May 09 04:28:43.974561 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 173/357] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:43 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:28:44.081850 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3ab01c8a-2d84-4a1a-a982-16e02ff1c8b9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:44.082232 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-535ec169-fc97-4b7c-bfe8-ec9e18c426d9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:44.083218 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3ab01c8a-2d84-4a1a-a982-16e02ff1c8b9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:44.091086 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-535ec169-fc97-4b7c-bfe8-ec9e18c426d9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.155859 May 09 04:28:44.091387 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3ab01c8a-2d84-4a1a-a982-16e02ff1c8b9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:44.091684 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 185/358] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:43 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:44.091885 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3ab01c8a-2d84-4a1a-a982-16e02ff1c8b9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:44.092623 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3ab01c8a-2d84-4a1a-a982-16e02ff1c8b9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:44.093053 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3ab01c8a-2d84-4a1a-a982-16e02ff1c8b9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:44.222203 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3ab01c8a-2d84-4a1a-a982-16e02ff1c8b9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:44.229545 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3ab01c8a-2d84-4a1a-a982-16e02ff1c8b9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.151700 May 09 04:28:44.230115 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 174/359] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:44 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:44.264086 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-88365bb1-ad65-4e3e-9c4d-abdb0e6f4b6d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:44.264697 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-88365bb1-ad65-4e3e-9c4d-abdb0e6f4b6d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:44.271369 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-88365bb1-ad65-4e3e-9c4d-abdb0e6f4b6d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:44.271822 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-88365bb1-ad65-4e3e-9c4d-abdb0e6f4b6d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:44.272595 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-88365bb1-ad65-4e3e-9c4d-abdb0e6f4b6d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:44.273022 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-88365bb1-ad65-4e3e-9c4d-abdb0e6f4b6d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:44.397842 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-88365bb1-ad65-4e3e-9c4d-abdb0e6f4b6d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:44.405315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-88365bb1-ad65-4e3e-9c4d-abdb0e6f4b6d tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.145158 May 09 04:28:44.405887 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 186/360] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:44 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:44.597030 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b8d514f5-91e6-4498-9afc-efd03ca07e3d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:44.597585 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b8d514f5-91e6-4498-9afc-efd03ca07e3d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:44.603848 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b8d514f5-91e6-4498-9afc-efd03ca07e3d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:44.604318 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b8d514f5-91e6-4498-9afc-efd03ca07e3d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:44.605079 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b8d514f5-91e6-4498-9afc-efd03ca07e3d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:44.605537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b8d514f5-91e6-4498-9afc-efd03ca07e3d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:44.735694 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b8d514f5-91e6-4498-9afc-efd03ca07e3d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:44.745177 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b8d514f5-91e6-4498-9afc-efd03ca07e3d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.151925 May 09 04:28:44.745770 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 175/361] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:44 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:44.860632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e8b52d41-22b5-4dce-b80c-78938b23d81e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:44.862016 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e8b52d41-22b5-4dce-b80c-78938b23d81e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:44.870360 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e8b52d41-22b5-4dce-b80c-78938b23d81e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:44.871107 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e8b52d41-22b5-4dce-b80c-78938b23d81e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:44.872113 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e8b52d41-22b5-4dce-b80c-78938b23d81e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:44.872494 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e8b52d41-22b5-4dce-b80c-78938b23d81e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:44.992457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8800e511-e1e9-4180-9c59-cb681610f927 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:44.993071 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8800e511-e1e9-4180-9c59-cb681610f927 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:44.999853 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8800e511-e1e9-4180-9c59-cb681610f927 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:45.000408 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8800e511-e1e9-4180-9c59-cb681610f927 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:45.001611 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8800e511-e1e9-4180-9c59-cb681610f927 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:45.002057 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8800e511-e1e9-4180-9c59-cb681610f927 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:45.048563 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e8b52d41-22b5-4dce-b80c-78938b23d81e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:45.058849 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e8b52d41-22b5-4dce-b80c-78938b23d81e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.203129 May 09 04:28:45.068423 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 187/362] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:44 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:45.108770 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1edb0730-f778-46e4-ba53-2159f56d6187 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:45.109383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1edb0730-f778-46e4-ba53-2159f56d6187 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:45.116045 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1edb0730-f778-46e4-ba53-2159f56d6187 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:45.116413 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1edb0730-f778-46e4-ba53-2159f56d6187 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:45.117182 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1edb0730-f778-46e4-ba53-2159f56d6187 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:45.117640 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1edb0730-f778-46e4-ba53-2159f56d6187 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:45.266486 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8800e511-e1e9-4180-9c59-cb681610f927 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:45.279939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8800e511-e1e9-4180-9c59-cb681610f927 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:45.281597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8800e511-e1e9-4180-9c59-cb681610f927 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:45.282853 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8800e511-e1e9-4180-9c59-cb681610f927 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.295213 May 09 04:28:45.292042 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 176/363] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:44 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:45.296886 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d04cb022-ff2b-4179-93ab-fc7c10e382d5 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:45.297515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d04cb022-ff2b-4179-93ab-fc7c10e382d5 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:45.304116 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d04cb022-ff2b-4179-93ab-fc7c10e382d5 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:45.304468 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d04cb022-ff2b-4179-93ab-fc7c10e382d5 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:45.305232 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d04cb022-ff2b-4179-93ab-fc7c10e382d5 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:45.305663 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d04cb022-ff2b-4179-93ab-fc7c10e382d5 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:45.339071 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1edb0730-f778-46e4-ba53-2159f56d6187 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:45.350127 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1edb0730-f778-46e4-ba53-2159f56d6187 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.245462 May 09 04:28:45.350918 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 188/364] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:45 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:45.423044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-11bd7b1c-6970-43e3-aa50-808684d9b001 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:45.423044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-11bd7b1c-6970-43e3-aa50-808684d9b001 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:45.431586 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-11bd7b1c-6970-43e3-aa50-808684d9b001 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:45.432156 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-11bd7b1c-6970-43e3-aa50-808684d9b001 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:45.433566 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-11bd7b1c-6970-43e3-aa50-808684d9b001 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:45.434003 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-11bd7b1c-6970-43e3-aa50-808684d9b001 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:45.448354 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d04cb022-ff2b-4179-93ab-fc7c10e382d5 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:45.457258 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d04cb022-ff2b-4179-93ab-fc7c10e382d5 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.164045 May 09 04:28:45.457856 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 177/365] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:45 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:45.667389 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-11bd7b1c-6970-43e3-aa50-808684d9b001 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:45.675461 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-11bd7b1c-6970-43e3-aa50-808684d9b001 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.257011 May 09 04:28:45.691110 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-ab5c68fd-d991-4d4a-b60e-6bc0e57e951f req-2c38c200-0f35-498a-80f6-331281631325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52cecb3-2634-4f9e-a9df-1ae4595bb3e1", "tag": "675e6f12-2f41-46e3-b8d5-09ed37ae4a6f"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:45.712703 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 189/366] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:45 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:45.713927 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-ab5c68fd-d991-4d4a-b60e-6bc0e57e951f req-2c38c200-0f35-498a-80f6-331281631325 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:45.714370 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-ab5c68fd-d991-4d4a-b60e-6bc0e57e951f req-2c38c200-0f35-498a-80f6-331281631325 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:45.726779 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-ab5c68fd-d991-4d4a-b60e-6bc0e57e951f req-2c38c200-0f35-498a-80f6-331281631325 service nova] Creating event network-changed:675e6f12-2f41-46e3-b8d5-09ed37ae4a6f for instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 on hv-cinder-83800 May 09 04:28:45.732119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-ab5c68fd-d991-4d4a-b60e-6bc0e57e951f req-2c38c200-0f35-498a-80f6-331281631325 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045359 May 09 04:28:45.736075 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 178/367] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:28:45.762399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-0d9b4e8a-88b0-40b7-8a05-83650230b226 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:45.763006 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-0d9b4e8a-88b0-40b7-8a05-83650230b226 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:45.769502 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0d9b4e8a-88b0-40b7-8a05-83650230b226 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:45.769946 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0d9b4e8a-88b0-40b7-8a05-83650230b226 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:45.770719 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0d9b4e8a-88b0-40b7-8a05-83650230b226 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:45.771711 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0d9b4e8a-88b0-40b7-8a05-83650230b226 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:45.905625 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-0d9b4e8a-88b0-40b7-8a05-83650230b226 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:45.913730 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-0d9b4e8a-88b0-40b7-8a05-83650230b226 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.155143 May 09 04:28:45.914231 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 190/368] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:45 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:46.077358 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-db703877-e3c2-48b8-91b5-7f15c6be3e86 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:46.078056 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-db703877-e3c2-48b8-91b5-7f15c6be3e86 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:46.084795 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-db703877-e3c2-48b8-91b5-7f15c6be3e86 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:46.085242 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-db703877-e3c2-48b8-91b5-7f15c6be3e86 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:46.086001 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-db703877-e3c2-48b8-91b5-7f15c6be3e86 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:46.086436 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-db703877-e3c2-48b8-91b5-7f15c6be3e86 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:46.280917 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-db703877-e3c2-48b8-91b5-7f15c6be3e86 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:46.289195 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-db703877-e3c2-48b8-91b5-7f15c6be3e86 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.215906 May 09 04:28:46.289708 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 179/369] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:46 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:46.302642 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-36fbd8b2-bb25-4b40-87f2-cfc223a93de1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:46.303291 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-36fbd8b2-bb25-4b40-87f2-cfc223a93de1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:46.309349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-36fbd8b2-bb25-4b40-87f2-cfc223a93de1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:46.309798 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-36fbd8b2-bb25-4b40-87f2-cfc223a93de1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:46.310685 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-36fbd8b2-bb25-4b40-87f2-cfc223a93de1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:46.311124 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-36fbd8b2-bb25-4b40-87f2-cfc223a93de1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:46.366529 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-535fd734-e4e1-4080-b69f-57370ef71d66 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:46.367234 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-535fd734-e4e1-4080-b69f-57370ef71d66 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:46.373348 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-535fd734-e4e1-4080-b69f-57370ef71d66 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:46.373868 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-535fd734-e4e1-4080-b69f-57370ef71d66 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:46.374713 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-535fd734-e4e1-4080-b69f-57370ef71d66 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:46.375224 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-535fd734-e4e1-4080-b69f-57370ef71d66 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:46.463258 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-36fbd8b2-bb25-4b40-87f2-cfc223a93de1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:46.471398 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-36fbd8b2-bb25-4b40-87f2-cfc223a93de1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:46.473038 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-36fbd8b2-bb25-4b40-87f2-cfc223a93de1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:46.474301 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-36fbd8b2-bb25-4b40-87f2-cfc223a93de1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.175762 May 09 04:28:46.474937 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 191/370] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:46 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:46.479540 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-11ab12be-e9b8-43a3-bd33-1ee1573d3123 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:46.480284 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-11ab12be-e9b8-43a3-bd33-1ee1573d3123 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:46.486473 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-11ab12be-e9b8-43a3-bd33-1ee1573d3123 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:46.486922 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-11ab12be-e9b8-43a3-bd33-1ee1573d3123 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:46.487689 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-11ab12be-e9b8-43a3-bd33-1ee1573d3123 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:46.488149 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-11ab12be-e9b8-43a3-bd33-1ee1573d3123 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:46.510122 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-535fd734-e4e1-4080-b69f-57370ef71d66 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:46.517486 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-535fd734-e4e1-4080-b69f-57370ef71d66 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.154883 May 09 04:28:46.518055 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 180/371] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:46 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:46.624209 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-11ab12be-e9b8-43a3-bd33-1ee1573d3123 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:46.631871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-11ab12be-e9b8-43a3-bd33-1ee1573d3123 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.155909 May 09 04:28:46.632466 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 192/372] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:46 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:46.692781 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-024b540a-6506-49ff-9721-0910b8585733 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:46.693567 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-024b540a-6506-49ff-9721-0910b8585733 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:46.699463 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-024b540a-6506-49ff-9721-0910b8585733 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:46.699945 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-024b540a-6506-49ff-9721-0910b8585733 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:46.700718 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-024b540a-6506-49ff-9721-0910b8585733 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:46.701154 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-024b540a-6506-49ff-9721-0910b8585733 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:46.910409 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-024b540a-6506-49ff-9721-0910b8585733 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:46.918394 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-024b540a-6506-49ff-9721-0910b8585733 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1258 microversion: 2.1 time: 0.229843 May 09 04:28:46.918956 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 181/373] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:46 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1258 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:46.930246 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5a4743dd-3a2c-489f-92c0-40d2c90c2394 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:46.930864 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5a4743dd-3a2c-489f-92c0-40d2c90c2394 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:46.936738 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5a4743dd-3a2c-489f-92c0-40d2c90c2394 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:46.937189 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5a4743dd-3a2c-489f-92c0-40d2c90c2394 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:46.937954 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5a4743dd-3a2c-489f-92c0-40d2c90c2394 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:46.938398 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5a4743dd-3a2c-489f-92c0-40d2c90c2394 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:47.070070 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5a4743dd-3a2c-489f-92c0-40d2c90c2394 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:47.077402 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5a4743dd-3a2c-489f-92c0-40d2c90c2394 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.151536 May 09 04:28:47.077949 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 193/374] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:46 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:47.305635 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-84629113-1365-465f-b13d-ac4c78316687 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:47.306166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-84629113-1365-465f-b13d-ac4c78316687 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:47.312144 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-84629113-1365-465f-b13d-ac4c78316687 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:47.312600 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-84629113-1365-465f-b13d-ac4c78316687 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:47.313877 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-84629113-1365-465f-b13d-ac4c78316687 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:47.314311 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-84629113-1365-465f-b13d-ac4c78316687 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:47.445930 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-84629113-1365-465f-b13d-ac4c78316687 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:47.454311 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-84629113-1365-465f-b13d-ac4c78316687 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.152683 May 09 04:28:47.454873 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 182/375] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:47 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:47.493836 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a7a3d1bd-5afa-4924-9a3d-91e423ad5dc2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:47.494559 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a7a3d1bd-5afa-4924-9a3d-91e423ad5dc2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:47.500494 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7a3d1bd-5afa-4924-9a3d-91e423ad5dc2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:47.500946 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7a3d1bd-5afa-4924-9a3d-91e423ad5dc2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:47.501714 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7a3d1bd-5afa-4924-9a3d-91e423ad5dc2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:47.502153 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7a3d1bd-5afa-4924-9a3d-91e423ad5dc2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:47.534293 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c4d12e0f-1cf3-449e-a0d6-c04ccaa3bb27 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:47.535008 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c4d12e0f-1cf3-449e-a0d6-c04ccaa3bb27 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:47.541135 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4d12e0f-1cf3-449e-a0d6-c04ccaa3bb27 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:47.541627 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4d12e0f-1cf3-449e-a0d6-c04ccaa3bb27 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:47.542471 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4d12e0f-1cf3-449e-a0d6-c04ccaa3bb27 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:47.542992 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4d12e0f-1cf3-449e-a0d6-c04ccaa3bb27 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:47.632252 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a7a3d1bd-5afa-4924-9a3d-91e423ad5dc2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:47.640312 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a7a3d1bd-5afa-4924-9a3d-91e423ad5dc2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:47.641922 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a7a3d1bd-5afa-4924-9a3d-91e423ad5dc2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:47.652349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a7a3d1bd-5afa-4924-9a3d-91e423ad5dc2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1744 microversion: 2.20 time: 0.154417 May 09 04:28:47.652995 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 194/376] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:47 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:47.657977 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f9a47d69-7af8-433d-87f4-960120017b19 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:47.658582 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f9a47d69-7af8-433d-87f4-960120017b19 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:47.665920 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f9a47d69-7af8-433d-87f4-960120017b19 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:47.666373 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f9a47d69-7af8-433d-87f4-960120017b19 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:47.667133 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f9a47d69-7af8-433d-87f4-960120017b19 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:47.667564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f9a47d69-7af8-433d-87f4-960120017b19 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:47.680917 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c4d12e0f-1cf3-449e-a0d6-c04ccaa3bb27 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:47.688344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c4d12e0f-1cf3-449e-a0d6-c04ccaa3bb27 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.157808 May 09 04:28:47.688922 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 183/377] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:47 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:47.793924 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f9a47d69-7af8-433d-87f4-960120017b19 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:47.801182 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f9a47d69-7af8-433d-87f4-960120017b19 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.147218 May 09 04:28:47.801749 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 195/378] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:47 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:47.934507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fbe13915-d8c3-4862-877e-786e110cd607 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:47.935073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fbe13915-d8c3-4862-877e-786e110cd607 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:47.941535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fbe13915-d8c3-4862-877e-786e110cd607 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:47.941984 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fbe13915-d8c3-4862-877e-786e110cd607 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:47.942743 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fbe13915-d8c3-4862-877e-786e110cd607 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:47.943463 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fbe13915-d8c3-4862-877e-786e110cd607 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:48.094886 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b62e6445-e15f-466f-b83a-139a47ad6e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:48.095493 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b62e6445-e15f-466f-b83a-139a47ad6e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:48.097325 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fbe13915-d8c3-4862-877e-786e110cd607 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:48.102832 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b62e6445-e15f-466f-b83a-139a47ad6e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:48.103287 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b62e6445-e15f-466f-b83a-139a47ad6e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:48.104165 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b62e6445-e15f-466f-b83a-139a47ad6e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:48.104612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b62e6445-e15f-466f-b83a-139a47ad6e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:48.106014 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fbe13915-d8c3-4862-877e-786e110cd607 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1443 microversion: 2.1 time: 0.175344 May 09 04:28:48.106803 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 184/379] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:47 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1443 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:48.122850 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0fa81744-f899-43f2-80dd-8a776f05ebb8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:48.123449 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0fa81744-f899-43f2-80dd-8a776f05ebb8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:48.129181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0fa81744-f899-43f2-80dd-8a776f05ebb8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:48.129621 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0fa81744-f899-43f2-80dd-8a776f05ebb8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:48.130423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0fa81744-f899-43f2-80dd-8a776f05ebb8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:48.130852 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0fa81744-f899-43f2-80dd-8a776f05ebb8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:48.242934 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b62e6445-e15f-466f-b83a-139a47ad6e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:48.250286 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b62e6445-e15f-466f-b83a-139a47ad6e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.159160 May 09 04:28:48.250862 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 196/380] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:48 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:48.258503 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0fa81744-f899-43f2-80dd-8a776f05ebb8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:48.265782 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0fa81744-f899-43f2-80dd-8a776f05ebb8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1443 microversion: 2.1 time: 0.146734 May 09 04:28:48.266344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 185/381] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:48 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1443 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:48.472112 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3b7464aa-a514-40e1-83f0-d8eab7a30ed0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:48.472731 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-3b7464aa-a514-40e1-83f0-d8eab7a30ed0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:48.479325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3b7464aa-a514-40e1-83f0-d8eab7a30ed0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:48.479772 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3b7464aa-a514-40e1-83f0-d8eab7a30ed0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:48.480564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3b7464aa-a514-40e1-83f0-d8eab7a30ed0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:48.480986 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3b7464aa-a514-40e1-83f0-d8eab7a30ed0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:48.611191 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3b7464aa-a514-40e1-83f0-d8eab7a30ed0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:48.619359 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-3b7464aa-a514-40e1-83f0-d8eab7a30ed0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.151209 May 09 04:28:48.619950 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 197/382] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:48 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:48.670501 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3e2e34a5-5b00-4ef7-aa69-7b2809b04163 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:48.671144 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3e2e34a5-5b00-4ef7-aa69-7b2809b04163 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:48.677085 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e2e34a5-5b00-4ef7-aa69-7b2809b04163 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:48.677735 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e2e34a5-5b00-4ef7-aa69-7b2809b04163 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:48.678684 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e2e34a5-5b00-4ef7-aa69-7b2809b04163 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:48.679116 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e2e34a5-5b00-4ef7-aa69-7b2809b04163 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:48.705030 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6cb1a578-68da-497a-9c90-6d75bdddd3a7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:48.705543 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6cb1a578-68da-497a-9c90-6d75bdddd3a7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:48.712591 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6cb1a578-68da-497a-9c90-6d75bdddd3a7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:48.713035 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6cb1a578-68da-497a-9c90-6d75bdddd3a7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:48.713879 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6cb1a578-68da-497a-9c90-6d75bdddd3a7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:48.714317 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6cb1a578-68da-497a-9c90-6d75bdddd3a7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:48.849569 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-6cb1a578-68da-497a-9c90-6d75bdddd3a7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:48.857062 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6cb1a578-68da-497a-9c90-6d75bdddd3a7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.155920 May 09 04:28:48.857832 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 198/383] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:48 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:48.862287 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-120c933a-bcbf-42c4-a64f-bebcecb763cd tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:48.862884 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-120c933a-bcbf-42c4-a64f-bebcecb763cd tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:48.870322 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-120c933a-bcbf-42c4-a64f-bebcecb763cd tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:48.870825 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-120c933a-bcbf-42c4-a64f-bebcecb763cd tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:48.871603 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-120c933a-bcbf-42c4-a64f-bebcecb763cd tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:48.872077 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-120c933a-bcbf-42c4-a64f-bebcecb763cd tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:48.945991 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3e2e34a5-5b00-4ef7-aa69-7b2809b04163 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:48.953986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3e2e34a5-5b00-4ef7-aa69-7b2809b04163 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:48.955584 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3e2e34a5-5b00-4ef7-aa69-7b2809b04163 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:48.956562 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3e2e34a5-5b00-4ef7-aa69-7b2809b04163 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1744 microversion: 2.20 time: 0.289883 May 09 04:28:48.957239 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 186/384] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:48 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1744 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:49.058717 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-120c933a-bcbf-42c4-a64f-bebcecb763cd tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:49.066745 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-120c933a-bcbf-42c4-a64f-bebcecb763cd tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.207735 May 09 04:28:49.067308 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 199/385] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:48 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:49.266984 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8fffaaf1-e1bb-49b5-9aa1-bc5eb0d4cf9b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:49.267759 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8fffaaf1-e1bb-49b5-9aa1-bc5eb0d4cf9b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:49.274524 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8fffaaf1-e1bb-49b5-9aa1-bc5eb0d4cf9b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:49.275631 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8fffaaf1-e1bb-49b5-9aa1-bc5eb0d4cf9b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:49.275795 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8fffaaf1-e1bb-49b5-9aa1-bc5eb0d4cf9b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:49.276226 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8fffaaf1-e1bb-49b5-9aa1-bc5eb0d4cf9b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:49.573227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8fffaaf1-e1bb-49b5-9aa1-bc5eb0d4cf9b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:49.580760 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8fffaaf1-e1bb-49b5-9aa1-bc5eb0d4cf9b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.317832 May 09 04:28:49.581550 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 187/386] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:49 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:49.637629 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8160e769-e59b-40df-832b-8d3de58a30de tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:49.638455 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8160e769-e59b-40df-832b-8d3de58a30de tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:49.644788 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8160e769-e59b-40df-832b-8d3de58a30de tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:49.645320 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8160e769-e59b-40df-832b-8d3de58a30de tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:49.646303 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8160e769-e59b-40df-832b-8d3de58a30de tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:49.647429 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8160e769-e59b-40df-832b-8d3de58a30de tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:49.783829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8160e769-e59b-40df-832b-8d3de58a30de tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:49.792813 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8160e769-e59b-40df-832b-8d3de58a30de tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1724 microversion: 2.1 time: 0.159103 May 09 04:28:49.803436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 200/387] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:49 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:49.875140 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0ce97966-6194-4644-ac67-989503dcf738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:49.875744 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0ce97966-6194-4644-ac67-989503dcf738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:49.882142 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ce97966-6194-4644-ac67-989503dcf738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:49.882642 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ce97966-6194-4644-ac67-989503dcf738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:49.883411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ce97966-6194-4644-ac67-989503dcf738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:49.883841 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ce97966-6194-4644-ac67-989503dcf738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:49.977550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ea10389c-4ff7-4948-8363-69341aa4d233 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:49.978195 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ea10389c-4ff7-4948-8363-69341aa4d233 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:49.984114 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ea10389c-4ff7-4948-8363-69341aa4d233 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:49.984561 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ea10389c-4ff7-4948-8363-69341aa4d233 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:49.985329 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ea10389c-4ff7-4948-8363-69341aa4d233 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:49.985764 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ea10389c-4ff7-4948-8363-69341aa4d233 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:50.125619 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ea10389c-4ff7-4948-8363-69341aa4d233 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:50.134378 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ea10389c-4ff7-4948-8363-69341aa4d233 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:50.137144 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ea10389c-4ff7-4948-8363-69341aa4d233 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:50.138437 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ea10389c-4ff7-4948-8363-69341aa4d233 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1744 microversion: 2.20 time: 0.165630 May 09 04:28:50.139095 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 201/388] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:49 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:50.143643 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ac043904-d028-4c6e-981b-4a2d9c2227b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:50.144282 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ac043904-d028-4c6e-981b-4a2d9c2227b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:50.151626 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ac043904-d028-4c6e-981b-4a2d9c2227b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:50.152112 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ac043904-d028-4c6e-981b-4a2d9c2227b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:50.152898 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ac043904-d028-4c6e-981b-4a2d9c2227b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:50.153334 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ac043904-d028-4c6e-981b-4a2d9c2227b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:50.288372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ac043904-d028-4c6e-981b-4a2d9c2227b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:50.295991 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ac043904-d028-4c6e-981b-4a2d9c2227b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.155897 May 09 04:28:50.296682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 202/389] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:50 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:50.453871 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0ce97966-6194-4644-ac67-989503dcf738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:50.462030 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0ce97966-6194-4644-ac67-989503dcf738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.590706 May 09 04:28:50.462615 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 188/390] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:49 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:50.598324 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-7e20dcdd-4a27-4c51-a756-40936a9bc72b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:50.598932 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-7e20dcdd-4a27-4c51-a756-40936a9bc72b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:50.605048 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7e20dcdd-4a27-4c51-a756-40936a9bc72b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:50.605493 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7e20dcdd-4a27-4c51-a756-40936a9bc72b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:50.606263 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7e20dcdd-4a27-4c51-a756-40936a9bc72b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:50.606689 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7e20dcdd-4a27-4c51-a756-40936a9bc72b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:50.738691 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-7e20dcdd-4a27-4c51-a756-40936a9bc72b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:50.752608 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-7e20dcdd-4a27-4c51-a756-40936a9bc72b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.157901 May 09 04:28:50.753387 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 203/391] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:50 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:50.805788 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-abb8d019-811b-4bcd-95f2-c70c427ef50b req-e3397d49-ab75-482b-8dc6-ee61d7054164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a541a008-c541-407b-8868-a2b9d98ed15d", "tag": "8b3c8f68-461e-4b7f-843a-747af41739b1"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:50.814519 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-7c1fb0ca-d3a4-4f38-a847-02a59646475d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:50.814818 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-abb8d019-811b-4bcd-95f2-c70c427ef50b req-e3397d49-ab75-482b-8dc6-ee61d7054164 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:50.815130 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-7c1fb0ca-d3a4-4f38-a847-02a59646475d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:50.815427 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-abb8d019-811b-4bcd-95f2-c70c427ef50b req-e3397d49-ab75-482b-8dc6-ee61d7054164 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:50.821811 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7c1fb0ca-d3a4-4f38-a847-02a59646475d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:50.822261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7c1fb0ca-d3a4-4f38-a847-02a59646475d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:50.823036 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7c1fb0ca-d3a4-4f38-a847-02a59646475d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:50.823476 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7c1fb0ca-d3a4-4f38-a847-02a59646475d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:50.835762 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-abb8d019-811b-4bcd-95f2-c70c427ef50b req-e3397d49-ab75-482b-8dc6-ee61d7054164 service nova] Creating event network-changed:8b3c8f68-461e-4b7f-843a-747af41739b1 for instance a541a008-c541-407b-8868-a2b9d98ed15d on hv-cinder-83800 May 09 04:28:50.841301 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-abb8d019-811b-4bcd-95f2-c70c427ef50b req-e3397d49-ab75-482b-8dc6-ee61d7054164 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039480 May 09 04:28:50.841903 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 189/392] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:28:50.957782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-7c1fb0ca-d3a4-4f38-a847-02a59646475d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:50.966249 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-7c1fb0ca-d3a4-4f38-a847-02a59646475d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1701 microversion: 2.1 time: 0.155558 May 09 04:28:50.966908 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 204/393] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:50 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:50.983835 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e827586c-8ae3-4d2b-9f57-574c9d35906a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:50.990637 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e827586c-8ae3-4d2b-9f57-574c9d35906a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:50.991068 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e827586c-8ae3-4d2b-9f57-574c9d35906a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.051570 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e827586c-8ae3-4d2b-9f57-574c9d35906a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Going to try to start instance {{(pid=117032) start /opt/stack/nova/nova/compute/api.py:2730}} May 09 04:28:51.098209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e827586c-8ae3-4d2b-9f57-574c9d35906a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "POST /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/action" status: 202 len: 0 microversion: 2.1 time: 0.118333 May 09 04:28:51.107154 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-eae39c75-368f-45bf-90dd-c53e89f9694a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:51.108282 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-eae39c75-368f-45bf-90dd-c53e89f9694a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:51.113681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 190/394] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 04:28:50 2022] POST /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:28:51.116268 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eae39c75-368f-45bf-90dd-c53e89f9694a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.117033 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eae39c75-368f-45bf-90dd-c53e89f9694a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.118325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eae39c75-368f-45bf-90dd-c53e89f9694a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.119134 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eae39c75-368f-45bf-90dd-c53e89f9694a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.157670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f294ee7d-371b-4d3a-b3b8-d471880c3c17 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:51.158684 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f294ee7d-371b-4d3a-b3b8-d471880c3c17 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:51.165454 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f294ee7d-371b-4d3a-b3b8-d471880c3c17 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.165900 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f294ee7d-371b-4d3a-b3b8-d471880c3c17 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.166661 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f294ee7d-371b-4d3a-b3b8-d471880c3c17 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.167090 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f294ee7d-371b-4d3a-b3b8-d471880c3c17 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.292366 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-eae39c75-368f-45bf-90dd-c53e89f9694a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:51.301600 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-eae39c75-368f-45bf-90dd-c53e89f9694a tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1710 microversion: 2.1 time: 0.198109 May 09 04:28:51.302752 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 205/395] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:51 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1710 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:51.316010 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a68c3148-fb59-4e09-b91e-c810f8a2dd94 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:51.319385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a68c3148-fb59-4e09-b91e-c810f8a2dd94 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:51.324194 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f294ee7d-371b-4d3a-b3b8-d471880c3c17 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:51.326524 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a68c3148-fb59-4e09-b91e-c810f8a2dd94 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.327136 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a68c3148-fb59-4e09-b91e-c810f8a2dd94 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.328604 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a68c3148-fb59-4e09-b91e-c810f8a2dd94 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.329351 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a68c3148-fb59-4e09-b91e-c810f8a2dd94 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.333316 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f294ee7d-371b-4d3a-b3b8-d471880c3c17 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:51.336495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f294ee7d-371b-4d3a-b3b8-d471880c3c17 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:51.338053 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f294ee7d-371b-4d3a-b3b8-d471880c3c17 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1744 microversion: 2.20 time: 0.184913 May 09 04:28:51.339063 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 191/396] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:51 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1744 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:51.394544 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-7985db0b-12d9-4663-bbb2-a2bcb021e253 req-20352b12-6b8f-4b4d-aa90-3be5970210cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d10350c6-bf15-414f-9bf7-d371b6912be2", "name": "network-vif-plugged", "status": "completed", "tag": "2abd51b8-3b37-4ec3-841e-462a68eb5cbc"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:51.402179 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-7985db0b-12d9-4663-bbb2-a2bcb021e253 req-20352b12-6b8f-4b4d-aa90-3be5970210cc service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.402641 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-7985db0b-12d9-4663-bbb2-a2bcb021e253 req-20352b12-6b8f-4b4d-aa90-3be5970210cc service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.415234 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-7985db0b-12d9-4663-bbb2-a2bcb021e253 req-20352b12-6b8f-4b4d-aa90-3be5970210cc service nova] Creating event network-vif-plugged:2abd51b8-3b37-4ec3-841e-462a68eb5cbc for instance d10350c6-bf15-414f-9bf7-d371b6912be2 on hv-cinder-83800 May 09 04:28:51.420959 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-7985db0b-12d9-4663-bbb2-a2bcb021e253 req-20352b12-6b8f-4b4d-aa90-3be5970210cc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030350 May 09 04:28:51.421993 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 192/397] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:28:51.474651 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a68c3148-fb59-4e09-b91e-c810f8a2dd94 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:51.480616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a3dce6e0-7213-42e3-8236-55c8dfed20dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:51.481378 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a3dce6e0-7213-42e3-8236-55c8dfed20dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:51.482952 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a68c3148-fb59-4e09-b91e-c810f8a2dd94 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.172791 May 09 04:28:51.483628 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 206/398] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:51 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:51.488382 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a3dce6e0-7213-42e3-8236-55c8dfed20dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.489013 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a3dce6e0-7213-42e3-8236-55c8dfed20dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.490062 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a3dce6e0-7213-42e3-8236-55c8dfed20dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.490669 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a3dce6e0-7213-42e3-8236-55c8dfed20dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.622991 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a3dce6e0-7213-42e3-8236-55c8dfed20dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:51.631000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a3dce6e0-7213-42e3-8236-55c8dfed20dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1501 microversion: 2.1 time: 0.155300 May 09 04:28:51.631972 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 193/399] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:51 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:51.648273 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3671c2b7-e030-4020-adf7-93373f697f76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cb21636-01d9-403e-929a-07b62ec41a71"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:51.649416 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-3671c2b7-e030-4020-adf7-93373f697f76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:51.655495 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3671c2b7-e030-4020-adf7-93373f697f76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.655967 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3671c2b7-e030-4020-adf7-93373f697f76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.656734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3671c2b7-e030-4020-adf7-93373f697f76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.657159 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3671c2b7-e030-4020-adf7-93373f697f76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.681232 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-3671c2b7-e030-4020-adf7-93373f697f76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] HTTP exception thrown: Cannot 'attach_volume' instance 6774e618-8e5f-4815-8e60-0473be16aabc while it is in vm_state rescued May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3671c2b7-e030-4020-adf7-93373f697f76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Request method failure captured: May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: POST /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc/os-volume_attachments HTTP/1.1 May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 74 May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJf7cd7GDKD--ciqHRq6mwpqDN3h9WRQb3Nc7UnOPo5U2WWp_HyVseZh-Z25QJN0hWRsF1_rRoMji4tz5UYqyzyZD9uv_aEy-DLscIeYW26RnR5edf_QFqZ2j-8nWp_I7Woej_Jl3fU2TVCdYMFK88Cwyxa_cQIHDAAuA7M0Y3pC4Zw May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: d28d5139952d450fa3b7da38a62d7a03 May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:28:51.683137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:28:51.684760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:28:51.684760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:28:51.684760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: d28d5139952d450fa3b7da38a62d7a03 May 09 04:28:51.684760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:28:51.684760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-ServerRescueNegativeTestJSON-1341609376-project May 09 04:28:51.684760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:28:51.684760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:28:51.684760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 87b7c3ec77d4493dac92bb61d0b376be May 09 04:28:51.684760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1341609376-project May 09 04:28:51.684760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: May 09 04:28:51.684760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {"volumeAttachment": {"volumeId": "0cb21636-01d9-403e-929a-07b62ec41a71"}} May 09 04:28:51.684760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Cannot 'attach_volume' instance 6774e618-8e5f-4815-8e60-0473be16aabc while it is in vm_state rescued May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'server_id': '6774e618-8e5f-4815-8e60-0473be16aabc', 'body': {'volumeAttachment': {'volumeId': '0cb21636-01d9-403e-929a-07b62ec41a71'}}} May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6774e618-8e5f-4815-8e60-0473be16aabc in vm_state rescued. Cannot attach_volume while the instance is in this state. May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:28:51.685564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6774e618-8e5f-4815-8e60-0473be16aabc while it is in vm_state rescued May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:28:51.686790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:28:51.687834 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:28:51.687834 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:28:51.687834 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6774e618-8e5f-4815-8e60-0473be16aabc while it is in vm_state rescued May 09 04:28:51.687834 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:28:51.687834 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3671c2b7-e030-4020-adf7-93373f697f76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Returning 409 to user: Cannot 'attach_volume' instance 6774e618-8e5f-4815-8e60-0473be16aabc while it is in vm_state rescued {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:28:51.687834 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-3671c2b7-e030-4020-adf7-93373f697f76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "POST /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041004 May 09 04:28:51.687834 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 207/400] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 04:28:51 2022] POST /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 09 04:28:51.694197 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f13bf26b-3619-418e-ae2e-311c358673f1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:51.694772 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f13bf26b-3619-418e-ae2e-311c358673f1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:51.703778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f13bf26b-3619-418e-ae2e-311c358673f1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.704414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f13bf26b-3619-418e-ae2e-311c358673f1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.705327 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f13bf26b-3619-418e-ae2e-311c358673f1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.705886 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f13bf26b-3619-418e-ae2e-311c358673f1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.770324 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c120fd35-7993-49ee-8c3c-d01a423f7a12 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:51.771810 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c120fd35-7993-49ee-8c3c-d01a423f7a12 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:51.778632 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f13bf26b-3619-418e-ae2e-311c358673f1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "POST /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc/action" status: 202 len: 0 microversion: 2.1 time: 0.088638 May 09 04:28:51.779413 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 194/401] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 04:28:51 2022] POST /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:28:51.779536 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c120fd35-7993-49ee-8c3c-d01a423f7a12 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.780006 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c120fd35-7993-49ee-8c3c-d01a423f7a12 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.780956 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c120fd35-7993-49ee-8c3c-d01a423f7a12 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.781399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c120fd35-7993-49ee-8c3c-d01a423f7a12 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.789298 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c21caca4-7c5d-459d-99fe-590a285fcfd2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:51.790143 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c21caca4-7c5d-459d-99fe-590a285fcfd2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:51.796339 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c21caca4-7c5d-459d-99fe-590a285fcfd2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.796885 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c21caca4-7c5d-459d-99fe-590a285fcfd2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.797714 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c21caca4-7c5d-459d-99fe-590a285fcfd2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:51.798211 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c21caca4-7c5d-459d-99fe-590a285fcfd2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:51.930343 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c120fd35-7993-49ee-8c3c-d01a423f7a12 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:51.936373 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c21caca4-7c5d-459d-99fe-590a285fcfd2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:51.938474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c120fd35-7993-49ee-8c3c-d01a423f7a12 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.172176 May 09 04:28:51.939044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 208/402] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:51 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:51.944538 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c21caca4-7c5d-459d-99fe-590a285fcfd2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1509 microversion: 2.1 time: 0.159738 May 09 04:28:51.945100 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 195/403] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:51 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:52.319862 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-984f5311-ba6e-49d7-86bc-151e4e3cd801 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:52.320633 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-984f5311-ba6e-49d7-86bc-151e4e3cd801 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:52.327387 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-984f5311-ba6e-49d7-86bc-151e4e3cd801 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:52.327955 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-984f5311-ba6e-49d7-86bc-151e4e3cd801 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:52.328859 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-984f5311-ba6e-49d7-86bc-151e4e3cd801 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:52.329370 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-984f5311-ba6e-49d7-86bc-151e4e3cd801 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:52.357042 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-66c32904-8737-49c8-979f-67a84d714960 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:52.358465 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-66c32904-8737-49c8-979f-67a84d714960 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:52.366152 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-66c32904-8737-49c8-979f-67a84d714960 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:52.366623 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-66c32904-8737-49c8-979f-67a84d714960 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:52.367468 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-66c32904-8737-49c8-979f-67a84d714960 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:52.368410 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-66c32904-8737-49c8-979f-67a84d714960 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:52.595203 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-984f5311-ba6e-49d7-86bc-151e4e3cd801 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:52.620827 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-984f5311-ba6e-49d7-86bc-151e4e3cd801 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1710 microversion: 2.1 time: 0.304771 May 09 04:28:52.622012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 209/404] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:52 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1710 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:52.628781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-00298e8f-8132-4322-bbff-92be03d4c8e0 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:52.629889 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-00298e8f-8132-4322-bbff-92be03d4c8e0 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:52.640591 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-00298e8f-8132-4322-bbff-92be03d4c8e0 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:52.641044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-00298e8f-8132-4322-bbff-92be03d4c8e0 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:52.641982 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-00298e8f-8132-4322-bbff-92be03d4c8e0 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:52.642794 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-00298e8f-8132-4322-bbff-92be03d4c8e0 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:52.653511 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-66c32904-8737-49c8-979f-67a84d714960 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:52.669587 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-66c32904-8737-49c8-979f-67a84d714960 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:52.671232 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-66c32904-8737-49c8-979f-67a84d714960 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:52.676854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-66c32904-8737-49c8-979f-67a84d714960 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1744 microversion: 2.20 time: 0.324185 May 09 04:28:52.680895 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 196/405] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:52 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1744 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:28:52.957170 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4338d14d-9afe-4e89-9cb9-f255107939be tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:52.957787 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4338d14d-9afe-4e89-9cb9-f255107939be tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:52.974866 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4338d14d-9afe-4e89-9cb9-f255107939be tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:52.975824 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4338d14d-9afe-4e89-9cb9-f255107939be tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:52.976843 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4338d14d-9afe-4e89-9cb9-f255107939be tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:52.977438 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4338d14d-9afe-4e89-9cb9-f255107939be tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:53.080695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-00298e8f-8132-4322-bbff-92be03d4c8e0 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:53.089280 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-00298e8f-8132-4322-bbff-92be03d4c8e0 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.465900 May 09 04:28:53.101911 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 210/406] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:52 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:53.108018 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8d739649-f1cf-4a33-b169-c7834f9646b4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:53.108863 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8d739649-f1cf-4a33-b169-c7834f9646b4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:53.115098 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8d739649-f1cf-4a33-b169-c7834f9646b4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:53.115868 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8d739649-f1cf-4a33-b169-c7834f9646b4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:53.116917 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8d739649-f1cf-4a33-b169-c7834f9646b4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:53.117583 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8d739649-f1cf-4a33-b169-c7834f9646b4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:53.517059 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8d739649-f1cf-4a33-b169-c7834f9646b4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:53.522982 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4338d14d-9afe-4e89-9cb9-f255107939be tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:53.528687 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8d739649-f1cf-4a33-b169-c7834f9646b4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1509 microversion: 2.1 time: 0.425205 May 09 04:28:53.540378 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 211/407] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:53 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1509 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:53.543074 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4338d14d-9afe-4e89-9cb9-f255107939be tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.589613 May 09 04:28:53.543658 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 197/408] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:52 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:53.642785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c21b9601-09b4-4684-a8a2-5eed7e492111 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:53.644126 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c21b9601-09b4-4684-a8a2-5eed7e492111 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:53.651490 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c21b9601-09b4-4684-a8a2-5eed7e492111 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:53.652466 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c21b9601-09b4-4684-a8a2-5eed7e492111 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:53.653910 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c21b9601-09b4-4684-a8a2-5eed7e492111 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:53.654572 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c21b9601-09b4-4684-a8a2-5eed7e492111 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:53.701915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fd0e8239-6c94-4fc6-a495-cb60a9ebc26b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:53.702491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fd0e8239-6c94-4fc6-a495-cb60a9ebc26b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:53.710076 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fd0e8239-6c94-4fc6-a495-cb60a9ebc26b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:53.710845 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fd0e8239-6c94-4fc6-a495-cb60a9ebc26b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:53.712209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fd0e8239-6c94-4fc6-a495-cb60a9ebc26b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:53.712737 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fd0e8239-6c94-4fc6-a495-cb60a9ebc26b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:53.816170 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c21b9601-09b4-4684-a8a2-5eed7e492111 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:53.832637 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c21b9601-09b4-4684-a8a2-5eed7e492111 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1710 microversion: 2.1 time: 0.194154 May 09 04:28:53.834278 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 212/409] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:53 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1710 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:53.883685 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fd0e8239-6c94-4fc6-a495-cb60a9ebc26b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:53.893055 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fd0e8239-6c94-4fc6-a495-cb60a9ebc26b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:53.895154 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fd0e8239-6c94-4fc6-a495-cb60a9ebc26b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:53.896894 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fd0e8239-6c94-4fc6-a495-cb60a9ebc26b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1739 microversion: 2.20 time: 0.198541 May 09 04:28:53.897805 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 198/410] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:53 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:28:54.122559 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-154a4659-87bf-4b5c-bafb-570eaa08ece7 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:54.123999 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-154a4659-87bf-4b5c-bafb-570eaa08ece7 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:54.132381 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-154a4659-87bf-4b5c-bafb-570eaa08ece7 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:54.133175 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-154a4659-87bf-4b5c-bafb-570eaa08ece7 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:54.134181 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-154a4659-87bf-4b5c-bafb-570eaa08ece7 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:54.134818 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-154a4659-87bf-4b5c-bafb-570eaa08ece7 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:54.293800 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-154a4659-87bf-4b5c-bafb-570eaa08ece7 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:54.301687 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-154a4659-87bf-4b5c-bafb-570eaa08ece7 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.196314 May 09 04:28:54.302479 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 213/411] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:54 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:54.549704 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5b85bdce-c2b2-4b04-a782-1d66a76ef0e9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:54.550509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5b85bdce-c2b2-4b04-a782-1d66a76ef0e9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:54.557713 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b85bdce-c2b2-4b04-a782-1d66a76ef0e9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:54.558412 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b85bdce-c2b2-4b04-a782-1d66a76ef0e9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:54.559357 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b85bdce-c2b2-4b04-a782-1d66a76ef0e9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:54.559998 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b85bdce-c2b2-4b04-a782-1d66a76ef0e9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:54.563586 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-84e6d75b-02b1-4060-a457-11f8f8cd66a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:54.563586 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-84e6d75b-02b1-4060-a457-11f8f8cd66a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:54.571708 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-84e6d75b-02b1-4060-a457-11f8f8cd66a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:54.572189 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-84e6d75b-02b1-4060-a457-11f8f8cd66a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:54.573005 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-84e6d75b-02b1-4060-a457-11f8f8cd66a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:54.573439 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-84e6d75b-02b1-4060-a457-11f8f8cd66a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:54.743686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5b85bdce-c2b2-4b04-a782-1d66a76ef0e9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:54.748886 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-84e6d75b-02b1-4060-a457-11f8f8cd66a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:54.752252 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5b85bdce-c2b2-4b04-a782-1d66a76ef0e9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1509 microversion: 2.1 time: 0.208861 May 09 04:28:54.766550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-84e6d75b-02b1-4060-a457-11f8f8cd66a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.209754 May 09 04:28:54.766975 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 199/412] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:54 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:54.767584 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 214/413] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:54 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:54.851361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0ba939b4-eb2a-4e43-ad1a-2b46ab380778 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:54.852329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0ba939b4-eb2a-4e43-ad1a-2b46ab380778 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:54.858607 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ba939b4-eb2a-4e43-ad1a-2b46ab380778 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:54.859257 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ba939b4-eb2a-4e43-ad1a-2b46ab380778 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:54.860218 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ba939b4-eb2a-4e43-ad1a-2b46ab380778 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:54.860809 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ba939b4-eb2a-4e43-ad1a-2b46ab380778 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:54.918438 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-930fd8c1-22df-4d68-b44d-48349bc21055 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:54.919150 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-930fd8c1-22df-4d68-b44d-48349bc21055 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:54.931396 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-930fd8c1-22df-4d68-b44d-48349bc21055 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:54.931949 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-930fd8c1-22df-4d68-b44d-48349bc21055 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:54.932953 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-930fd8c1-22df-4d68-b44d-48349bc21055 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:54.933577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-930fd8c1-22df-4d68-b44d-48349bc21055 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:55.013266 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0ba939b4-eb2a-4e43-ad1a-2b46ab380778 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:55.022899 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0ba939b4-eb2a-4e43-ad1a-2b46ab380778 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1710 microversion: 2.1 time: 0.176121 May 09 04:28:55.023861 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 200/414] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:54 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1710 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:55.106081 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-930fd8c1-22df-4d68-b44d-48349bc21055 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:55.115211 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-930fd8c1-22df-4d68-b44d-48349bc21055 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:55.117021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-930fd8c1-22df-4d68-b44d-48349bc21055 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:55.118450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-930fd8c1-22df-4d68-b44d-48349bc21055 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1739 microversion: 2.20 time: 0.204605 May 09 04:28:55.130774 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 215/415] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:54 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:28:55.321987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b598ddbf-251e-442a-a188-c60b392c9e9a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:55.322812 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b598ddbf-251e-442a-a188-c60b392c9e9a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:55.331404 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b598ddbf-251e-442a-a188-c60b392c9e9a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:55.332013 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b598ddbf-251e-442a-a188-c60b392c9e9a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:55.332932 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b598ddbf-251e-442a-a188-c60b392c9e9a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:55.333521 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b598ddbf-251e-442a-a188-c60b392c9e9a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:55.494793 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b598ddbf-251e-442a-a188-c60b392c9e9a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:55.517022 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b598ddbf-251e-442a-a188-c60b392c9e9a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.201746 May 09 04:28:55.517812 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 201/416] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:55 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:55.527313 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-57a347c6-a535-4a6c-9a98-0a5edae3b101 req-bcc45c71-2f27-4114-a29b-be5433309070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52cecb3-2634-4f9e-a9df-1ae4595bb3e1", "name": "network-vif-plugged", "status": "completed", "tag": "675e6f12-2f41-46e3-b8d5-09ed37ae4a6f"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:28:55.538664 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-57a347c6-a535-4a6c-9a98-0a5edae3b101 req-bcc45c71-2f27-4114-a29b-be5433309070 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:55.539625 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-57a347c6-a535-4a6c-9a98-0a5edae3b101 req-bcc45c71-2f27-4114-a29b-be5433309070 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:55.564182 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-57a347c6-a535-4a6c-9a98-0a5edae3b101 req-bcc45c71-2f27-4114-a29b-be5433309070 service nova] Creating event network-vif-plugged:675e6f12-2f41-46e3-b8d5-09ed37ae4a6f for instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 on hv-cinder-83800 May 09 04:28:55.578174 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-57a347c6-a535-4a6c-9a98-0a5edae3b101 req-bcc45c71-2f27-4114-a29b-be5433309070 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068501 May 09 04:28:55.581833 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 216/417] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:28:55.774296 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-aa28334f-1dbb-4375-85fd-d460420c58b9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:55.775658 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-aa28334f-1dbb-4375-85fd-d460420c58b9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:55.782269 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa28334f-1dbb-4375-85fd-d460420c58b9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:55.782975 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa28334f-1dbb-4375-85fd-d460420c58b9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:55.783772 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-01134a4f-a8e7-484f-b75f-5610ced6fe93 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:55.784104 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa28334f-1dbb-4375-85fd-d460420c58b9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:55.784673 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa28334f-1dbb-4375-85fd-d460420c58b9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:55.784798 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-01134a4f-a8e7-484f-b75f-5610ced6fe93 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:55.794921 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-01134a4f-a8e7-484f-b75f-5610ced6fe93 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:55.795375 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-01134a4f-a8e7-484f-b75f-5610ced6fe93 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:55.796175 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-01134a4f-a8e7-484f-b75f-5610ced6fe93 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:55.796783 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-01134a4f-a8e7-484f-b75f-5610ced6fe93 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:55.959735 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-aa28334f-1dbb-4375-85fd-d460420c58b9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:55.967978 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-aa28334f-1dbb-4375-85fd-d460420c58b9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1509 microversion: 2.1 time: 0.197932 May 09 04:28:55.974542 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 202/418] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:55 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:55.987766 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-01134a4f-a8e7-484f-b75f-5610ced6fe93 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:55.996915 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-01134a4f-a8e7-484f-b75f-5610ced6fe93 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.217438 May 09 04:28:56.000265 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 217/419] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:55 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:56.041247 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6cc19ba8-3aad-41ec-b1e9-7bb5ebdf5d10 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:56.041893 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6cc19ba8-3aad-41ec-b1e9-7bb5ebdf5d10 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:56.048238 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6cc19ba8-3aad-41ec-b1e9-7bb5ebdf5d10 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:56.048894 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6cc19ba8-3aad-41ec-b1e9-7bb5ebdf5d10 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:56.049689 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6cc19ba8-3aad-41ec-b1e9-7bb5ebdf5d10 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:56.050108 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6cc19ba8-3aad-41ec-b1e9-7bb5ebdf5d10 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:56.138895 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-dc172558-fe1a-4867-9dbe-49697b189e05 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:56.140244 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-dc172558-fe1a-4867-9dbe-49697b189e05 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:56.159536 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dc172558-fe1a-4867-9dbe-49697b189e05 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:56.160091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dc172558-fe1a-4867-9dbe-49697b189e05 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:56.169538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dc172558-fe1a-4867-9dbe-49697b189e05 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:56.170039 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dc172558-fe1a-4867-9dbe-49697b189e05 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:56.214878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6cc19ba8-3aad-41ec-b1e9-7bb5ebdf5d10 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:56.228700 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6cc19ba8-3aad-41ec-b1e9-7bb5ebdf5d10 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1710 microversion: 2.1 time: 0.192008 May 09 04:28:56.230687 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 203/420] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:56 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1710 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:56.399515 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-dc172558-fe1a-4867-9dbe-49697b189e05 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:56.409431 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-dc172558-fe1a-4867-9dbe-49697b189e05 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:56.411257 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-dc172558-fe1a-4867-9dbe-49697b189e05 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:56.412719 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-dc172558-fe1a-4867-9dbe-49697b189e05 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1739 microversion: 2.20 time: 0.277606 May 09 04:28:56.413388 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 218/421] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:56 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:56.533444 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0b18e896-8339-41a1-918f-a82e4500662b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:56.534370 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0b18e896-8339-41a1-918f-a82e4500662b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:56.541704 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0b18e896-8339-41a1-918f-a82e4500662b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:56.542150 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0b18e896-8339-41a1-918f-a82e4500662b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:56.542919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0b18e896-8339-41a1-918f-a82e4500662b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:56.543480 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0b18e896-8339-41a1-918f-a82e4500662b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:56.688297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0b18e896-8339-41a1-918f-a82e4500662b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:56.697232 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0b18e896-8339-41a1-918f-a82e4500662b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.167513 May 09 04:28:56.698046 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 204/422] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:56 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:56.985750 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ee40c88a-a5e1-41fa-b35c-9c50956ed45e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:56.986359 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ee40c88a-a5e1-41fa-b35c-9c50956ed45e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:56.992689 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ee40c88a-a5e1-41fa-b35c-9c50956ed45e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:56.993379 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ee40c88a-a5e1-41fa-b35c-9c50956ed45e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:56.994329 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ee40c88a-a5e1-41fa-b35c-9c50956ed45e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:56.994767 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ee40c88a-a5e1-41fa-b35c-9c50956ed45e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:57.018240 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7a916698-0a22-49fd-a23d-8e5338e501b6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:57.018843 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7a916698-0a22-49fd-a23d-8e5338e501b6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:57.030626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a916698-0a22-49fd-a23d-8e5338e501b6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:57.031344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a916698-0a22-49fd-a23d-8e5338e501b6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:57.034563 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a916698-0a22-49fd-a23d-8e5338e501b6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:57.038004 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a916698-0a22-49fd-a23d-8e5338e501b6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:57.246869 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7a916698-0a22-49fd-a23d-8e5338e501b6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:57.256869 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7a916698-0a22-49fd-a23d-8e5338e501b6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.242574 May 09 04:28:57.257698 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 205/423] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:57 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:57.269551 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-49776d97-2b05-4d53-a359-e6635b5fda45 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:57.270313 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-49776d97-2b05-4d53-a359-e6635b5fda45 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:57.276252 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ee40c88a-a5e1-41fa-b35c-9c50956ed45e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:57.277923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-49776d97-2b05-4d53-a359-e6635b5fda45 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:57.278374 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-49776d97-2b05-4d53-a359-e6635b5fda45 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:57.279152 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-49776d97-2b05-4d53-a359-e6635b5fda45 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:57.280112 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-49776d97-2b05-4d53-a359-e6635b5fda45 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:57.284193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ee40c88a-a5e1-41fa-b35c-9c50956ed45e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1509 microversion: 2.1 time: 0.302198 May 09 04:28:57.294956 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 219/424] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:56 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:57.420133 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-49776d97-2b05-4d53-a359-e6635b5fda45 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:57.432124 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-49776d97-2b05-4d53-a359-e6635b5fda45 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1714 microversion: 2.1 time: 0.170255 May 09 04:28:57.433034 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 206/425] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:57 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1714 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:57.435508 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e720db9d-2740-4a45-a16c-e91836eada1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:57.435508 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e720db9d-2740-4a45-a16c-e91836eada1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:57.446586 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e720db9d-2740-4a45-a16c-e91836eada1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:57.447036 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e720db9d-2740-4a45-a16c-e91836eada1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:57.447807 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e720db9d-2740-4a45-a16c-e91836eada1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:57.448593 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e720db9d-2740-4a45-a16c-e91836eada1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:57.599632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e720db9d-2740-4a45-a16c-e91836eada1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:57.607855 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e720db9d-2740-4a45-a16c-e91836eada1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:57.609448 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e720db9d-2740-4a45-a16c-e91836eada1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:57.610925 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e720db9d-2740-4a45-a16c-e91836eada1d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1739 microversion: 2.20 time: 0.180799 May 09 04:28:57.623505 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 220/426] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:57 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:28:57.714739 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ab54505d-8888-4ad3-ab32-f33125df27e6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:57.715263 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ab54505d-8888-4ad3-ab32-f33125df27e6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:57.723453 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ab54505d-8888-4ad3-ab32-f33125df27e6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:57.724234 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ab54505d-8888-4ad3-ab32-f33125df27e6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:57.725192 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ab54505d-8888-4ad3-ab32-f33125df27e6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:57.725786 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ab54505d-8888-4ad3-ab32-f33125df27e6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:57.878127 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ab54505d-8888-4ad3-ab32-f33125df27e6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:57.887423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ab54505d-8888-4ad3-ab32-f33125df27e6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.177083 May 09 04:28:57.888553 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 207/427] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:57 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:58.277449 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-30e0a343-513b-4eaf-9bdd-d93b24f33494 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:58.278715 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-30e0a343-513b-4eaf-9bdd-d93b24f33494 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:58.285304 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-30e0a343-513b-4eaf-9bdd-d93b24f33494 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:58.285741 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-30e0a343-513b-4eaf-9bdd-d93b24f33494 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:58.287143 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-30e0a343-513b-4eaf-9bdd-d93b24f33494 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:58.287704 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-30e0a343-513b-4eaf-9bdd-d93b24f33494 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:58.305823 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3f572812-8344-47db-be81-2067bd9abea9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:58.305823 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3f572812-8344-47db-be81-2067bd9abea9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:58.316433 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f572812-8344-47db-be81-2067bd9abea9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:58.316891 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f572812-8344-47db-be81-2067bd9abea9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:58.323787 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f572812-8344-47db-be81-2067bd9abea9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:58.324966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f572812-8344-47db-be81-2067bd9abea9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:58.449841 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-30e0a343-513b-4eaf-9bdd-d93b24f33494 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:58.459557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-30e0a343-513b-4eaf-9bdd-d93b24f33494 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.186817 May 09 04:28:58.460392 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 221/428] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:58 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:58.506386 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3f572812-8344-47db-be81-2067bd9abea9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:58.514429 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3f572812-8344-47db-be81-2067bd9abea9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1515 microversion: 2.1 time: 0.213831 May 09 04:28:58.515036 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 208/429] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:58 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:28:58.646897 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d030fbea-29d3-49a7-bf3f-392cff4e63cc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:58.652044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d030fbea-29d3-49a7-bf3f-392cff4e63cc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:58.673527 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d030fbea-29d3-49a7-bf3f-392cff4e63cc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:58.674082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d030fbea-29d3-49a7-bf3f-392cff4e63cc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:58.675503 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d030fbea-29d3-49a7-bf3f-392cff4e63cc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:58.675998 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d030fbea-29d3-49a7-bf3f-392cff4e63cc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:58.862210 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d030fbea-29d3-49a7-bf3f-392cff4e63cc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:58.873418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d030fbea-29d3-49a7-bf3f-392cff4e63cc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:58.875324 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d030fbea-29d3-49a7-bf3f-392cff4e63cc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:58.876709 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d030fbea-29d3-49a7-bf3f-392cff4e63cc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1739 microversion: 2.20 time: 0.234926 May 09 04:28:58.877395 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 222/430] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:58 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:28:58.911784 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-48c173af-0f5a-4af4-ad6e-aedb561edfd8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:58.913063 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-48c173af-0f5a-4af4-ad6e-aedb561edfd8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:58.919795 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48c173af-0f5a-4af4-ad6e-aedb561edfd8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:58.920586 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48c173af-0f5a-4af4-ad6e-aedb561edfd8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:58.921723 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48c173af-0f5a-4af4-ad6e-aedb561edfd8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:58.922379 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48c173af-0f5a-4af4-ad6e-aedb561edfd8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:59.088956 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-48c173af-0f5a-4af4-ad6e-aedb561edfd8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:59.101068 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-48c173af-0f5a-4af4-ad6e-aedb561edfd8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.193895 May 09 04:28:59.110728 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 209/431] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:58 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:59.478628 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-98753521-b448-4132-82dd-bf5baa9fa9c4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:59.479254 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-98753521-b448-4132-82dd-bf5baa9fa9c4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:59.489338 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-98753521-b448-4132-82dd-bf5baa9fa9c4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:59.490312 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-98753521-b448-4132-82dd-bf5baa9fa9c4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:59.491140 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-98753521-b448-4132-82dd-bf5baa9fa9c4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:59.491550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-98753521-b448-4132-82dd-bf5baa9fa9c4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:59.667014 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-98753521-b448-4132-82dd-bf5baa9fa9c4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:28:59.674940 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-98753521-b448-4132-82dd-bf5baa9fa9c4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.201815 May 09 04:28:59.685181 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 223/432] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:28:59 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:28:59.897963 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9d927e6f-530c-42e7-85a3-1bf768fe19b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:28:59.900118 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9d927e6f-530c-42e7-85a3-1bf768fe19b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:28:59.909794 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9d927e6f-530c-42e7-85a3-1bf768fe19b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:59.910468 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9d927e6f-530c-42e7-85a3-1bf768fe19b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:28:59.911989 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9d927e6f-530c-42e7-85a3-1bf768fe19b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:28:59.912587 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9d927e6f-530c-42e7-85a3-1bf768fe19b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:00.084434 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-aaa368a2-e238-40ad-b868-c394a1331c0c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Action: 'create', calling method: .version_select at 0x7fbfd46e73a0>, body: {"keypair": {"name": "tempest-keypair-508069349"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:00.097007 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9d927e6f-530c-42e7-85a3-1bf768fe19b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:00.105623 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9d927e6f-530c-42e7-85a3-1bf768fe19b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:00.110305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9d927e6f-530c-42e7-85a3-1bf768fe19b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:00.115821 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9d927e6f-530c-42e7-85a3-1bf768fe19b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1739 microversion: 2.20 time: 0.223496 May 09 04:29:00.119966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 210/433] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:28:59 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:00.126095 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b4e01178-83ba-443e-b48f-7721c190b304 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:00.127396 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-aaa368a2-e238-40ad-b868-c394a1331c0c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Getting quotas for project d28d5139952d450fa3b7da38a62d7a03. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:29:00.130395 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b4e01178-83ba-443e-b48f-7721c190b304 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:00.135506 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-aaa368a2-e238-40ad-b868-c394a1331c0c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Getting quotas for user 87b7c3ec77d4493dac92bb61d0b376be and project d28d5139952d450fa3b7da38a62d7a03. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:29:00.142437 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b4e01178-83ba-443e-b48f-7721c190b304 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:00.147050 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b4e01178-83ba-443e-b48f-7721c190b304 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:00.148114 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b4e01178-83ba-443e-b48f-7721c190b304 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:00.150012 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b4e01178-83ba-443e-b48f-7721c190b304 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:00.272428 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-aaa368a2-e238-40ad-b868-c394a1331c0c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Getting quotas for project d28d5139952d450fa3b7da38a62d7a03. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:29:00.276873 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-aaa368a2-e238-40ad-b868-c394a1331c0c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Getting quotas for user 87b7c3ec77d4493dac92bb61d0b376be and project d28d5139952d450fa3b7da38a62d7a03. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:29:00.300022 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-aaa368a2-e238-40ad-b868-c394a1331c0c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.219993 May 09 04:29:00.301236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 224/434] 10.222.0.44 () {60 vars in 1157 bytes} [Mon May 9 04:29:00 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:00.346632 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b4e01178-83ba-443e-b48f-7721c190b304 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:00.354796 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b4e01178-83ba-443e-b48f-7721c190b304 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1358 microversion: 2.1 time: 0.233485 May 09 04:29:00.355466 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 211/435] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:00 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:00.692213 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3fc3b3ac-2f47-4dbc-8c83-44de9e25a54d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:00.692911 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-3fc3b3ac-2f47-4dbc-8c83-44de9e25a54d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:00.702019 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3fc3b3ac-2f47-4dbc-8c83-44de9e25a54d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:00.702761 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3fc3b3ac-2f47-4dbc-8c83-44de9e25a54d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:00.703703 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3fc3b3ac-2f47-4dbc-8c83-44de9e25a54d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:00.704333 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3fc3b3ac-2f47-4dbc-8c83-44de9e25a54d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:00.916140 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3fc3b3ac-2f47-4dbc-8c83-44de9e25a54d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:00.924878 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-3fc3b3ac-2f47-4dbc-8c83-44de9e25a54d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.236456 May 09 04:29:00.925822 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 225/436] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:00 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:01.137499 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-801a5c7e-c332-4d54-b20f-2f9eaa274649 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:01.138705 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-801a5c7e-c332-4d54-b20f-2f9eaa274649 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:01.147350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-801a5c7e-c332-4d54-b20f-2f9eaa274649 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:01.148377 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-801a5c7e-c332-4d54-b20f-2f9eaa274649 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:01.149405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-801a5c7e-c332-4d54-b20f-2f9eaa274649 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:01.149909 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-801a5c7e-c332-4d54-b20f-2f9eaa274649 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:01.371510 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e8f11dc3-f002-452c-8d9e-15e11d6ca94a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:01.372461 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e8f11dc3-f002-452c-8d9e-15e11d6ca94a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:01.379228 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e8f11dc3-f002-452c-8d9e-15e11d6ca94a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:01.380801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e8f11dc3-f002-452c-8d9e-15e11d6ca94a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:01.381930 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e8f11dc3-f002-452c-8d9e-15e11d6ca94a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:01.382623 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e8f11dc3-f002-452c-8d9e-15e11d6ca94a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:01.550899 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e8f11dc3-f002-452c-8d9e-15e11d6ca94a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:01.566822 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e8f11dc3-f002-452c-8d9e-15e11d6ca94a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1548 microversion: 2.1 time: 0.196483 May 09 04:29:01.581642 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 226/437] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:01 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1548 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:01.596199 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-801a5c7e-c332-4d54-b20f-2f9eaa274649 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:01.600648 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-65838d12-191e-4c93-8d93-d9fc045c2cd8 req-78d58421-96cf-4ac4-b381-9c96ac9fa914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25d4ade-5644-40c6-81ca-73ccc85df6e1", "name": "network-vif-plugged", "status": "completed", "tag": "f61a276d-0cef-4028-b9cc-fe9fb05d4f49"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:01.609124 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-801a5c7e-c332-4d54-b20f-2f9eaa274649 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:01.611679 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-801a5c7e-c332-4d54-b20f-2f9eaa274649 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:01.613734 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-801a5c7e-c332-4d54-b20f-2f9eaa274649 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1739 microversion: 2.20 time: 0.480142 May 09 04:29:01.615443 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 212/438] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:01 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1739 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:01.617720 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-65838d12-191e-4c93-8d93-d9fc045c2cd8 req-78d58421-96cf-4ac4-b381-9c96ac9fa914 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:01.618176 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-65838d12-191e-4c93-8d93-d9fc045c2cd8 req-78d58421-96cf-4ac4-b381-9c96ac9fa914 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:01.620772 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-483e91e7-7dfc-42b9-9da5-b64ee7f7147b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:01.621422 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-483e91e7-7dfc-42b9-9da5-b64ee7f7147b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:01.627926 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-483e91e7-7dfc-42b9-9da5-b64ee7f7147b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:01.628349 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-483e91e7-7dfc-42b9-9da5-b64ee7f7147b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:01.631122 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-483e91e7-7dfc-42b9-9da5-b64ee7f7147b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:01.631662 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-483e91e7-7dfc-42b9-9da5-b64ee7f7147b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:01.637762 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-65838d12-191e-4c93-8d93-d9fc045c2cd8 req-78d58421-96cf-4ac4-b381-9c96ac9fa914 service nova] Creating event network-vif-plugged:f61a276d-0cef-4028-b9cc-fe9fb05d4f49 for instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 on hv-cinder-83800 May 09 04:29:01.660458 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-65838d12-191e-4c93-8d93-d9fc045c2cd8 req-78d58421-96cf-4ac4-b381-9c96ac9fa914 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076961 May 09 04:29:01.661077 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 227/439] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:01.954895 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-483e91e7-7dfc-42b9-9da5-b64ee7f7147b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:01.963382 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ff05b2b5-02e4-49c3-af97-12b9811441c6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:01.964313 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-483e91e7-7dfc-42b9-9da5-b64ee7f7147b tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1548 microversion: 2.1 time: 0.346725 May 09 04:29:01.964433 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ff05b2b5-02e4-49c3-af97-12b9811441c6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:01.968774 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 213/440] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:01 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1548 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:01.975230 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ff05b2b5-02e4-49c3-af97-12b9811441c6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:01.975731 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ff05b2b5-02e4-49c3-af97-12b9811441c6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:01.976970 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ff05b2b5-02e4-49c3-af97-12b9811441c6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:01.977621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ff05b2b5-02e4-49c3-af97-12b9811441c6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:01.985776 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0e98608c-a6d1-4996-927b-947654ea49b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:01.992131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0e98608c-a6d1-4996-927b-947654ea49b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:01.993080 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0e98608c-a6d1-4996-927b-947654ea49b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Searching by: {'deleted': False, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161'} {{(pid=117032) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 09 04:29:02.001399 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0e98608c-a6d1-4996-927b-947654ea49b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:02.001947 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0e98608c-a6d1-4996-927b-947654ea49b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:02.002841 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0e98608c-a6d1-4996-927b-947654ea49b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:02.003571 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0e98608c-a6d1-4996-927b-947654ea49b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:02.109204 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.multi_cell_list [None req-0e98608c-a6d1-4996-927b-947654ea49b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 09 04:29:02.158692 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ff05b2b5-02e4-49c3-af97-12b9811441c6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:02.179295 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ff05b2b5-02e4-49c3-af97-12b9811441c6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.222167 May 09 04:29:02.193419 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 228/441] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:01 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:02.238139 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0e98608c-a6d1-4996-927b-947654ea49b1 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.256511 May 09 04:29:02.240128 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 214/442] 10.222.0.44 () {58 vars in 1124 bytes} [Mon May 9 04:29:01 2022] GET /compute/v2.1/servers => generated 343 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:02.251132 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c4ef6181-f13b-4c9a-a8fc-606b25b5fbdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:02.252170 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c4ef6181-f13b-4c9a-a8fc-606b25b5fbdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:02.259321 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c4ef6181-f13b-4c9a-a8fc-606b25b5fbdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:02.260153 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c4ef6181-f13b-4c9a-a8fc-606b25b5fbdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:02.261308 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c4ef6181-f13b-4c9a-a8fc-606b25b5fbdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:02.261821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c4ef6181-f13b-4c9a-a8fc-606b25b5fbdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:02.431344 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c4ef6181-f13b-4c9a-a8fc-606b25b5fbdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:02.441531 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c4ef6181-f13b-4c9a-a8fc-606b25b5fbdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1548 microversion: 2.1 time: 0.194264 May 09 04:29:02.443168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 229/443] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:02 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1548 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:02.528217 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-268663293", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cb94923-1093-45fc-bebd-e159f3ac8dd3"}], "security_groups": [{"name": "tempest-securitygroup--1781876163"}], "key_name": "tempest-keypair-508069349", "user_data": "}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:02.633413 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-306ab934-1d0e-400d-a1fc-76c6e9605b8e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:02.634526 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-306ab934-1d0e-400d-a1fc-76c6e9605b8e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:02.641169 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-306ab934-1d0e-400d-a1fc-76c6e9605b8e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:02.641894 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-306ab934-1d0e-400d-a1fc-76c6e9605b8e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:02.642674 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-306ab934-1d0e-400d-a1fc-76c6e9605b8e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:02.643114 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-306ab934-1d0e-400d-a1fc-76c6e9605b8e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:02.913967 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-306ab934-1d0e-400d-a1fc-76c6e9605b8e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:02.926134 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-306ab934-1d0e-400d-a1fc-76c6e9605b8e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:02.928292 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-306ab934-1d0e-400d-a1fc-76c6e9605b8e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:02.929633 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-306ab934-1d0e-400d-a1fc-76c6e9605b8e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1739 microversion: 2.20 time: 0.300599 May 09 04:29:02.930636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 230/444] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:02 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:29:02.953868 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] validate_networks() for [('9cb94923-1093-45fc-bebd-e159f3ac8dd3', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:29:03.197329 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-7a07dcea-cacd-44ea-85fc-a97d5336076d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:03.198281 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-7a07dcea-cacd-44ea-85fc-a97d5336076d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:03.206478 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7a07dcea-cacd-44ea-85fc-a97d5336076d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:03.206915 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7a07dcea-cacd-44ea-85fc-a97d5336076d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:03.207669 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7a07dcea-cacd-44ea-85fc-a97d5336076d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:03.208707 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7a07dcea-cacd-44ea-85fc-a97d5336076d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:03.335476 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:29:03.336000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:29:03.336416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:29:03.337312 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:29:03.337726 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:29:03.344732 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-7a07dcea-cacd-44ea-85fc-a97d5336076d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:03.346406 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:03.346856 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:03.347656 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:03.348127 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:03.352827 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-7a07dcea-cacd-44ea-85fc-a97d5336076d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1266 microversion: 2.1 time: 0.159981 May 09 04:29:03.353406 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 231/445] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:03 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:03.368762 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Getting quotas for project d28d5139952d450fa3b7da38a62d7a03. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:29:03.372703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Getting quotas for user 87b7c3ec77d4493dac92bb61d0b376be and project d28d5139952d450fa3b7da38a62d7a03. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:29:03.384087 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:29:03.386369 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:29:03.434903 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-06ad9d65-b55d-4b63-b8ad-c0f78f8f8c40 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.911034 May 09 04:29:03.435553 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 215/446] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:29:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:29:03.445585 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-9eb2e71e-4204-4116-bf0b-adc42807a1e2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:03.446222 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-9eb2e71e-4204-4116-bf0b-adc42807a1e2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:03.499529 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9eb2e71e-4204-4116-bf0b-adc42807a1e2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:03.506625 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-9eb2e71e-4204-4116-bf0b-adc42807a1e2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1244 microversion: 2.1 time: 0.065122 May 09 04:29:03.507190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 232/447] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:03 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1244 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:03.948960 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9b3607c4-f4c1-4383-bc99-5ca968235ce0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:03.949789 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9b3607c4-f4c1-4383-bc99-5ca968235ce0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:03.957488 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9b3607c4-f4c1-4383-bc99-5ca968235ce0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:03.957962 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9b3607c4-f4c1-4383-bc99-5ca968235ce0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:03.959637 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9b3607c4-f4c1-4383-bc99-5ca968235ce0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:03.960103 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9b3607c4-f4c1-4383-bc99-5ca968235ce0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:04.096976 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9b3607c4-f4c1-4383-bc99-5ca968235ce0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:04.105193 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9b3607c4-f4c1-4383-bc99-5ca968235ce0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:04.106726 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9b3607c4-f4c1-4383-bc99-5ca968235ce0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:04.107867 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9b3607c4-f4c1-4383-bc99-5ca968235ce0 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1721 microversion: 2.20 time: 0.164197 May 09 04:29:04.108488 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 216/448] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:03 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:04.126428 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6d669834-4535-4b48-bb95-2a49517987e2 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec7a0b02-2ddc-4f18-8f2e-28b67c00531b"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:04.127541 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6d669834-4535-4b48-bb95-2a49517987e2 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:04.134161 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6d669834-4535-4b48-bb95-2a49517987e2 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:04.134613 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6d669834-4535-4b48-bb95-2a49517987e2 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:04.135375 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6d669834-4535-4b48-bb95-2a49517987e2 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:04.135808 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6d669834-4535-4b48-bb95-2a49517987e2 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:04.369961 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fefc934c-1f55-40f2-8b82-ef59ad324242 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:04.370508 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fefc934c-1f55-40f2-8b82-ef59ad324242 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:04.377066 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fefc934c-1f55-40f2-8b82-ef59ad324242 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:04.377507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fefc934c-1f55-40f2-8b82-ef59ad324242 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:04.378255 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fefc934c-1f55-40f2-8b82-ef59ad324242 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:04.378682 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fefc934c-1f55-40f2-8b82-ef59ad324242 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:04.507532 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fefc934c-1f55-40f2-8b82-ef59ad324242 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:04.514800 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fefc934c-1f55-40f2-8b82-ef59ad324242 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1453 microversion: 2.1 time: 0.148699 May 09 04:29:04.515360 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 217/449] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:04 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:04.522508 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cc73cbec-6e01-4d43-ab7c-02fefcefcb72 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:04.523099 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-cc73cbec-6e01-4d43-ab7c-02fefcefcb72 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:04.529334 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cc73cbec-6e01-4d43-ab7c-02fefcefcb72 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:04.529782 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cc73cbec-6e01-4d43-ab7c-02fefcefcb72 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:04.530595 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cc73cbec-6e01-4d43-ab7c-02fefcefcb72 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:04.531084 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cc73cbec-6e01-4d43-ab7c-02fefcefcb72 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:04.618119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-cc73cbec-6e01-4d43-ab7c-02fefcefcb72 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:04.626178 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-cc73cbec-6e01-4d43-ab7c-02fefcefcb72 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1248 microversion: 2.1 time: 0.107621 May 09 04:29:04.627339 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 218/450] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:04 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1248 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:04.641010 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-34431b03-56e8-4b1f-aa04-357d76608784 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:04.641615 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-34431b03-56e8-4b1f-aa04-357d76608784 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:04.648305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34431b03-56e8-4b1f-aa04-357d76608784 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:04.648742 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34431b03-56e8-4b1f-aa04-357d76608784 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:04.649502 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34431b03-56e8-4b1f-aa04-357d76608784 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:04.649927 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34431b03-56e8-4b1f-aa04-357d76608784 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:04.812955 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6d669834-4535-4b48-bb95-2a49517987e2 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "POST /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690210 May 09 04:29:04.814089 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 233/451] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 04:29:04 2022] POST /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:04.892181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-34431b03-56e8-4b1f-aa04-357d76608784 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:04.900462 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-34431b03-56e8-4b1f-aa04-357d76608784 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1453 microversion: 2.1 time: 0.272148 May 09 04:29:04.901146 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 219/452] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:04 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1453 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:05.127549 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-11ca216d-5988-400f-8cb8-dc7387996c7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:05.128266 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-11ca216d-5988-400f-8cb8-dc7387996c7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:05.134945 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-11ca216d-5988-400f-8cb8-dc7387996c7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:05.135383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-11ca216d-5988-400f-8cb8-dc7387996c7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:05.136166 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-11ca216d-5988-400f-8cb8-dc7387996c7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:05.136611 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-11ca216d-5988-400f-8cb8-dc7387996c7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:05.355004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-11ca216d-5988-400f-8cb8-dc7387996c7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:05.368018 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-11ca216d-5988-400f-8cb8-dc7387996c7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:05.372112 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-11ca216d-5988-400f-8cb8-dc7387996c7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:05.374000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-11ca216d-5988-400f-8cb8-dc7387996c7f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1721 microversion: 2.20 time: 0.251049 May 09 04:29:05.374945 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 234/453] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:05 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:05.644824 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6911daf1-254c-4bb3-9841-61e73fa8dffa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:05.645814 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6911daf1-254c-4bb3-9841-61e73fa8dffa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:05.653496 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6911daf1-254c-4bb3-9841-61e73fa8dffa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:05.653496 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6911daf1-254c-4bb3-9841-61e73fa8dffa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:05.654368 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6911daf1-254c-4bb3-9841-61e73fa8dffa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:05.655132 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6911daf1-254c-4bb3-9841-61e73fa8dffa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:05.748662 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6911daf1-254c-4bb3-9841-61e73fa8dffa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:05.765311 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6911daf1-254c-4bb3-9841-61e73fa8dffa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1302 microversion: 2.1 time: 0.123922 May 09 04:29:05.766427 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 220/454] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:05 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1302 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:06.394803 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d215596c-75cf-47c1-bdf6-d23735652651 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:06.395342 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d215596c-75cf-47c1-bdf6-d23735652651 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:06.401642 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d215596c-75cf-47c1-bdf6-d23735652651 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:06.402096 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d215596c-75cf-47c1-bdf6-d23735652651 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:06.402871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d215596c-75cf-47c1-bdf6-d23735652651 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:06.403301 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d215596c-75cf-47c1-bdf6-d23735652651 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:06.538283 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d215596c-75cf-47c1-bdf6-d23735652651 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:06.546248 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d215596c-75cf-47c1-bdf6-d23735652651 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:06.547757 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d215596c-75cf-47c1-bdf6-d23735652651 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:06.548944 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d215596c-75cf-47c1-bdf6-d23735652651 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1721 microversion: 2.20 time: 0.158136 May 09 04:29:06.549513 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 235/455] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:06 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:06.782674 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d8254c34-dd6a-40e1-9396-101e7a402086 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:06.783278 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d8254c34-dd6a-40e1-9396-101e7a402086 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:06.790167 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d8254c34-dd6a-40e1-9396-101e7a402086 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:06.790612 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d8254c34-dd6a-40e1-9396-101e7a402086 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:06.791384 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d8254c34-dd6a-40e1-9396-101e7a402086 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:06.791819 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d8254c34-dd6a-40e1-9396-101e7a402086 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:06.986165 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-5920e17a-59b1-481e-aca5-1cf0752da63c req-f31966cf-99d4-4e66-9e2b-b4a6b5e0df63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25d4ade-5644-40c6-81ca-73ccc85df6e1", "tag": "f61a276d-0cef-4028-b9cc-fe9fb05d4f49"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:06.987915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d8254c34-dd6a-40e1-9396-101e7a402086 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:06.996394 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-5920e17a-59b1-481e-aca5-1cf0752da63c req-f31966cf-99d4-4e66-9e2b-b4a6b5e0df63 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:06.996835 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-5920e17a-59b1-481e-aca5-1cf0752da63c req-f31966cf-99d4-4e66-9e2b-b4a6b5e0df63 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:06.997131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d8254c34-dd6a-40e1-9396-101e7a402086 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.218342 May 09 04:29:06.997753 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 221/456] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:06 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:07.014563 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-5920e17a-59b1-481e-aca5-1cf0752da63c req-f31966cf-99d4-4e66-9e2b-b4a6b5e0df63 service nova] Creating event network-changed:f61a276d-0cef-4028-b9cc-fe9fb05d4f49 for instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 on hv-cinder-83800 May 09 04:29:07.019577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-5920e17a-59b1-481e-aca5-1cf0752da63c req-f31966cf-99d4-4e66-9e2b-b4a6b5e0df63 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045973 May 09 04:29:07.020232 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 236/457] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:07.397870 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-9ac8c398-03d8-49d8-9463-2a692fd6dc3e req-f437ff82-da10-4d8b-8b9e-87b5f326f455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d10350c6-bf15-414f-9bf7-d371b6912be2", "name": "network-vif-unplugged", "status": "completed", "tag": "2abd51b8-3b37-4ec3-841e-462a68eb5cbc"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:07.406448 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-9ac8c398-03d8-49d8-9463-2a692fd6dc3e req-f437ff82-da10-4d8b-8b9e-87b5f326f455 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:07.407143 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-9ac8c398-03d8-49d8-9463-2a692fd6dc3e req-f437ff82-da10-4d8b-8b9e-87b5f326f455 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:07.420004 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-9ac8c398-03d8-49d8-9463-2a692fd6dc3e req-f437ff82-da10-4d8b-8b9e-87b5f326f455 service nova] Creating event network-vif-unplugged:2abd51b8-3b37-4ec3-841e-462a68eb5cbc for instance d10350c6-bf15-414f-9bf7-d371b6912be2 on hv-cinder-83800 May 09 04:29:07.425866 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-9ac8c398-03d8-49d8-9463-2a692fd6dc3e req-f437ff82-da10-4d8b-8b9e-87b5f326f455 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031712 May 09 04:29:07.427845 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 222/458] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:07.568466 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-52da21da-b78e-41c7-98bd-cc7860fee1f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:07.569108 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-52da21da-b78e-41c7-98bd-cc7860fee1f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:07.575294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-52da21da-b78e-41c7-98bd-cc7860fee1f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:07.575739 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-52da21da-b78e-41c7-98bd-cc7860fee1f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:07.576533 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-52da21da-b78e-41c7-98bd-cc7860fee1f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:07.576969 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-52da21da-b78e-41c7-98bd-cc7860fee1f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:07.705712 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-52da21da-b78e-41c7-98bd-cc7860fee1f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:07.714811 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-52da21da-b78e-41c7-98bd-cc7860fee1f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:07.716347 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-52da21da-b78e-41c7-98bd-cc7860fee1f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:07.717521 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-52da21da-b78e-41c7-98bd-cc7860fee1f9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1721 microversion: 2.20 time: 0.153637 May 09 04:29:07.718171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 237/459] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:07 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:08.015165 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dda3f0b3-bccb-40d5-bba4-757c86bcd36f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:08.016651 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dda3f0b3-bccb-40d5-bba4-757c86bcd36f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:08.030920 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dda3f0b3-bccb-40d5-bba4-757c86bcd36f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:08.033356 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dda3f0b3-bccb-40d5-bba4-757c86bcd36f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:08.034302 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dda3f0b3-bccb-40d5-bba4-757c86bcd36f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:08.035603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dda3f0b3-bccb-40d5-bba4-757c86bcd36f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:08.471518 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dda3f0b3-bccb-40d5-bba4-757c86bcd36f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:08.480538 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dda3f0b3-bccb-40d5-bba4-757c86bcd36f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.469764 May 09 04:29:08.481444 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 223/460] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:08 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:08.629706 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-145861c7-19d4-4554-bd08-d0888f7a1fc3 req-3f34cd18-f0e5-43a2-8285-1866b7b7fe6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4473a2d0-b3cc-401b-b460-7c00c66893a0", "tag": "ef4e419e-4415-4b7c-b72d-4dbd68f98b15"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:08.654517 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-145861c7-19d4-4554-bd08-d0888f7a1fc3 req-3f34cd18-f0e5-43a2-8285-1866b7b7fe6f service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:08.655009 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-145861c7-19d4-4554-bd08-d0888f7a1fc3 req-3f34cd18-f0e5-43a2-8285-1866b7b7fe6f service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:08.671052 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-145861c7-19d4-4554-bd08-d0888f7a1fc3 req-3f34cd18-f0e5-43a2-8285-1866b7b7fe6f service nova] Creating event network-changed:ef4e419e-4415-4b7c-b72d-4dbd68f98b15 for instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 on hv-cinder-83800 May 09 04:29:08.687404 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-145861c7-19d4-4554-bd08-d0888f7a1fc3 req-3f34cd18-f0e5-43a2-8285-1866b7b7fe6f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058691 May 09 04:29:08.689691 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 238/461] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:08.736109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-84c01794-e22b-4c87-8932-7354a65ea48a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:08.736994 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-84c01794-e22b-4c87-8932-7354a65ea48a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:08.753479 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-84c01794-e22b-4c87-8932-7354a65ea48a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:08.759295 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-84c01794-e22b-4c87-8932-7354a65ea48a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:08.760404 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-84c01794-e22b-4c87-8932-7354a65ea48a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:08.761614 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-84c01794-e22b-4c87-8932-7354a65ea48a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:09.001877 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-84c01794-e22b-4c87-8932-7354a65ea48a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:09.012338 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-84c01794-e22b-4c87-8932-7354a65ea48a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:09.013831 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-84c01794-e22b-4c87-8932-7354a65ea48a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:09.015871 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-84c01794-e22b-4c87-8932-7354a65ea48a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1664 microversion: 2.20 time: 0.283180 May 09 04:29:09.028890 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 224/462] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:08 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1664 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:29:09.035357 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-98c8a13f-7c6e-4b36-90f0-d6a6db2534d1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0456a173-bfb2-4569-b0a2-f1d6e41d70b1"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:09.037140 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-98c8a13f-7c6e-4b36-90f0-d6a6db2534d1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:09.043939 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-98c8a13f-7c6e-4b36-90f0-d6a6db2534d1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:09.044486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-98c8a13f-7c6e-4b36-90f0-d6a6db2534d1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:09.045556 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-98c8a13f-7c6e-4b36-90f0-d6a6db2534d1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:09.045987 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-98c8a13f-7c6e-4b36-90f0-d6a6db2534d1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:09.327565 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-98c8a13f-7c6e-4b36-90f0-d6a6db2534d1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "POST /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296480 May 09 04:29:09.328255 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 239/463] 10.222.0.44 () {62 vars in 1363 bytes} [Mon May 9 04:29:09 2022] POST /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:29:09.438856 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bcbaf15e-2866-4c41-a8a0-ba4c1f5846c4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:09.439422 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-bcbaf15e-2866-4c41-a8a0-ba4c1f5846c4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:09.445873 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bcbaf15e-2866-4c41-a8a0-ba4c1f5846c4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:09.446317 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bcbaf15e-2866-4c41-a8a0-ba4c1f5846c4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:09.447076 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bcbaf15e-2866-4c41-a8a0-ba4c1f5846c4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:09.447509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bcbaf15e-2866-4c41-a8a0-ba4c1f5846c4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:09.497165 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ff8f8084-f020-45f2-8dc4-61bf0b7c7b76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:09.497773 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ff8f8084-f020-45f2-8dc4-61bf0b7c7b76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:09.504135 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ff8f8084-f020-45f2-8dc4-61bf0b7c7b76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:09.504582 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ff8f8084-f020-45f2-8dc4-61bf0b7c7b76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:09.505914 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ff8f8084-f020-45f2-8dc4-61bf0b7c7b76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:09.506347 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ff8f8084-f020-45f2-8dc4-61bf0b7c7b76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:09.540966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bcbaf15e-2866-4c41-a8a0-ba4c1f5846c4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "POST /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/action" status: 202 len: 0 microversion: 2.20 time: 0.105998 May 09 04:29:09.541912 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 225/464] 10.222.0.44 () {62 vars in 1318 bytes} [Mon May 9 04:29:09 2022] POST /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 04:29:09.549782 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a61ba45d-ee83-432d-ac37-f729e25a005b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:09.550491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a61ba45d-ee83-432d-ac37-f729e25a005b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:09.557045 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a61ba45d-ee83-432d-ac37-f729e25a005b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:09.557493 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a61ba45d-ee83-432d-ac37-f729e25a005b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:09.558315 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a61ba45d-ee83-432d-ac37-f729e25a005b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:09.558747 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a61ba45d-ee83-432d-ac37-f729e25a005b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:09.658087 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ff8f8084-f020-45f2-8dc4-61bf0b7c7b76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:09.666728 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ff8f8084-f020-45f2-8dc4-61bf0b7c7b76 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.173264 May 09 04:29:09.667769 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 240/465] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:09 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:09.699814 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a61ba45d-ee83-432d-ac37-f729e25a005b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:09.707997 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a61ba45d-ee83-432d-ac37-f729e25a005b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:09.709499 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a61ba45d-ee83-432d-ac37-f729e25a005b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:09.710661 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a61ba45d-ee83-432d-ac37-f729e25a005b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1750 microversion: 2.20 time: 0.165009 May 09 04:29:09.711417 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 226/466] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:09 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:10.685838 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f2219d08-d949-495a-bdaa-bb88dd25c49c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:10.687187 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f2219d08-d949-495a-bdaa-bb88dd25c49c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:10.694984 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f2219d08-d949-495a-bdaa-bb88dd25c49c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:10.695707 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f2219d08-d949-495a-bdaa-bb88dd25c49c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:10.696949 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f2219d08-d949-495a-bdaa-bb88dd25c49c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:10.697379 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f2219d08-d949-495a-bdaa-bb88dd25c49c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:10.729709 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cf1624ff-3d03-4e9a-abe1-2fea70b80c7e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:10.730542 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-cf1624ff-3d03-4e9a-abe1-2fea70b80c7e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:10.737176 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf1624ff-3d03-4e9a-abe1-2fea70b80c7e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:10.737620 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf1624ff-3d03-4e9a-abe1-2fea70b80c7e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:10.738724 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf1624ff-3d03-4e9a-abe1-2fea70b80c7e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:10.739845 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf1624ff-3d03-4e9a-abe1-2fea70b80c7e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:10.874701 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-cf1624ff-3d03-4e9a-abe1-2fea70b80c7e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:10.883582 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-cf1624ff-3d03-4e9a-abe1-2fea70b80c7e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:10.885138 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-cf1624ff-3d03-4e9a-abe1-2fea70b80c7e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:10.886354 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-cf1624ff-3d03-4e9a-abe1-2fea70b80c7e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1752 microversion: 2.20 time: 0.160463 May 09 04:29:10.886924 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 227/467] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:10 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:10.904387 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f2219d08-d949-495a-bdaa-bb88dd25c49c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:10.912441 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f2219d08-d949-495a-bdaa-bb88dd25c49c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.231360 May 09 04:29:10.913022 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 241/468] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:10 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:11.905157 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-58b3061d-c0e7-4ac6-b050-c0aeae2b159b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:11.905765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-58b3061d-c0e7-4ac6-b050-c0aeae2b159b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:11.912644 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58b3061d-c0e7-4ac6-b050-c0aeae2b159b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:11.913086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58b3061d-c0e7-4ac6-b050-c0aeae2b159b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:11.913841 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58b3061d-c0e7-4ac6-b050-c0aeae2b159b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:11.914270 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58b3061d-c0e7-4ac6-b050-c0aeae2b159b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:11.929618 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e94c9e9b-7985-49a3-a7b6-55d9b7b459b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:11.930221 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e94c9e9b-7985-49a3-a7b6-55d9b7b459b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:11.936499 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e94c9e9b-7985-49a3-a7b6-55d9b7b459b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:11.936942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e94c9e9b-7985-49a3-a7b6-55d9b7b459b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:11.937706 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e94c9e9b-7985-49a3-a7b6-55d9b7b459b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:11.938134 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e94c9e9b-7985-49a3-a7b6-55d9b7b459b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:12.047310 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-58b3061d-c0e7-4ac6-b050-c0aeae2b159b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:12.057216 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-58b3061d-c0e7-4ac6-b050-c0aeae2b159b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:12.058708 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-58b3061d-c0e7-4ac6-b050-c0aeae2b159b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:12.059864 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-58b3061d-c0e7-4ac6-b050-c0aeae2b159b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1752 microversion: 2.20 time: 0.158592 May 09 04:29:12.060448 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 228/469] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:11 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:12.137017 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e94c9e9b-7985-49a3-a7b6-55d9b7b459b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:12.147378 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e94c9e9b-7985-49a3-a7b6-55d9b7b459b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.222253 May 09 04:29:12.147983 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 242/470] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:11 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:12.398487 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5d78bf8a-09ac-4dd8-b479-29e920c476ed tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:12.399150 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5d78bf8a-09ac-4dd8-b479-29e920c476ed tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:12.405044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d78bf8a-09ac-4dd8-b479-29e920c476ed tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:12.405486 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d78bf8a-09ac-4dd8-b479-29e920c476ed tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:12.406247 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d78bf8a-09ac-4dd8-b479-29e920c476ed tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:12.406674 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d78bf8a-09ac-4dd8-b479-29e920c476ed tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:12.538341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5d78bf8a-09ac-4dd8-b479-29e920c476ed tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:12.546139 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5d78bf8a-09ac-4dd8-b479-29e920c476ed tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1594 microversion: 2.1 time: 0.151933 May 09 04:29:12.546712 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 229/471] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:12 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:13.078896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-63c35da5-eac2-4c45-bc99-ad78b7a5820a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:13.079511 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-63c35da5-eac2-4c45-bc99-ad78b7a5820a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:13.086460 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-63c35da5-eac2-4c45-bc99-ad78b7a5820a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:13.087193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-63c35da5-eac2-4c45-bc99-ad78b7a5820a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:13.088044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-63c35da5-eac2-4c45-bc99-ad78b7a5820a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:13.088840 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-63c35da5-eac2-4c45-bc99-ad78b7a5820a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:13.163525 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-21cb3fe5-3cbd-4ad0-9aa3-f51ba4aadc0f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:13.164172 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-21cb3fe5-3cbd-4ad0-9aa3-f51ba4aadc0f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:13.170822 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-21cb3fe5-3cbd-4ad0-9aa3-f51ba4aadc0f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:13.171402 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-21cb3fe5-3cbd-4ad0-9aa3-f51ba4aadc0f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:13.172057 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-21cb3fe5-3cbd-4ad0-9aa3-f51ba4aadc0f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:13.172488 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-21cb3fe5-3cbd-4ad0-9aa3-f51ba4aadc0f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:13.225948 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-63c35da5-eac2-4c45-bc99-ad78b7a5820a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:13.234545 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-63c35da5-eac2-4c45-bc99-ad78b7a5820a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:13.236100 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-63c35da5-eac2-4c45-bc99-ad78b7a5820a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:13.237342 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-63c35da5-eac2-4c45-bc99-ad78b7a5820a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.162550 May 09 04:29:13.237905 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 243/472] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:13 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:13.402401 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-21cb3fe5-3cbd-4ad0-9aa3-f51ba4aadc0f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:13.414534 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-21cb3fe5-3cbd-4ad0-9aa3-f51ba4aadc0f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.254720 May 09 04:29:13.415368 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 230/473] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:13 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:13.604518 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-b7ebefe8-ee4f-4d2c-9295-65f395f7b8d9 req-8ddf2237-3d84-49ee-90d0-3119edd2093a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4473a2d0-b3cc-401b-b460-7c00c66893a0", "name": "network-vif-plugged", "status": "completed", "tag": "ef4e419e-4415-4b7c-b72d-4dbd68f98b15"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:13.613674 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-b7ebefe8-ee4f-4d2c-9295-65f395f7b8d9 req-8ddf2237-3d84-49ee-90d0-3119edd2093a service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:13.614964 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-b7ebefe8-ee4f-4d2c-9295-65f395f7b8d9 req-8ddf2237-3d84-49ee-90d0-3119edd2093a service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:13.633875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-b7ebefe8-ee4f-4d2c-9295-65f395f7b8d9 req-8ddf2237-3d84-49ee-90d0-3119edd2093a service nova] Creating event network-vif-plugged:ef4e419e-4415-4b7c-b72d-4dbd68f98b15 for instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 on hv-cinder-83800 May 09 04:29:13.639162 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-b7ebefe8-ee4f-4d2c-9295-65f395f7b8d9 req-8ddf2237-3d84-49ee-90d0-3119edd2093a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037998 May 09 04:29:13.640063 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 244/474] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:14.256186 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ef649e1a-981e-4f6b-8394-920eebd5e9cd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:14.256790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ef649e1a-981e-4f6b-8394-920eebd5e9cd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:14.263212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ef649e1a-981e-4f6b-8394-920eebd5e9cd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:14.263655 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ef649e1a-981e-4f6b-8394-920eebd5e9cd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:14.264453 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ef649e1a-981e-4f6b-8394-920eebd5e9cd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:14.264889 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ef649e1a-981e-4f6b-8394-920eebd5e9cd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:14.430961 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-037fd056-3448-4fa5-bb37-3d0c6229095d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:14.431693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-037fd056-3448-4fa5-bb37-3d0c6229095d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:14.438246 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-037fd056-3448-4fa5-bb37-3d0c6229095d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:14.438705 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-037fd056-3448-4fa5-bb37-3d0c6229095d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:14.439518 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-037fd056-3448-4fa5-bb37-3d0c6229095d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:14.439992 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-037fd056-3448-4fa5-bb37-3d0c6229095d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:14.479720 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ef649e1a-981e-4f6b-8394-920eebd5e9cd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:14.488583 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ef649e1a-981e-4f6b-8394-920eebd5e9cd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:14.490693 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ef649e1a-981e-4f6b-8394-920eebd5e9cd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:14.491931 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ef649e1a-981e-4f6b-8394-920eebd5e9cd tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.239802 May 09 04:29:14.493208 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 231/475] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:14 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:14.582006 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-037fd056-3448-4fa5-bb37-3d0c6229095d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:14.590592 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-037fd056-3448-4fa5-bb37-3d0c6229095d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.163876 May 09 04:29:14.592451 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 245/476] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:14 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:14.606275 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-7d6d1481-c83e-47b7-b7f2-0660dabbf04a req-766fb05c-491c-4977-88ff-cfa300dfb1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52cecb3-2634-4f9e-a9df-1ae4595bb3e1", "tag": "675e6f12-2f41-46e3-b8d5-09ed37ae4a6f"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:14.615012 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-7d6d1481-c83e-47b7-b7f2-0660dabbf04a req-766fb05c-491c-4977-88ff-cfa300dfb1cf service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:14.615445 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-7d6d1481-c83e-47b7-b7f2-0660dabbf04a req-766fb05c-491c-4977-88ff-cfa300dfb1cf service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:14.627471 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-7d6d1481-c83e-47b7-b7f2-0660dabbf04a req-766fb05c-491c-4977-88ff-cfa300dfb1cf service nova] Creating event network-changed:675e6f12-2f41-46e3-b8d5-09ed37ae4a6f for instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 on hv-cinder-83800 May 09 04:29:14.633356 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-7d6d1481-c83e-47b7-b7f2-0660dabbf04a req-766fb05c-491c-4977-88ff-cfa300dfb1cf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030689 May 09 04:29:14.634126 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 232/477] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:15.512223 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b9fcb74a-6454-4076-bc05-da471565e584 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:15.513815 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b9fcb74a-6454-4076-bc05-da471565e584 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:15.531137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b9fcb74a-6454-4076-bc05-da471565e584 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:15.534063 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b9fcb74a-6454-4076-bc05-da471565e584 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:15.535116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b9fcb74a-6454-4076-bc05-da471565e584 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:15.538706 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b9fcb74a-6454-4076-bc05-da471565e584 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:15.615420 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9a61f4ad-87fb-4f30-81c4-8ff0b892fb9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:15.616191 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9a61f4ad-87fb-4f30-81c4-8ff0b892fb9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:15.630897 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9a61f4ad-87fb-4f30-81c4-8ff0b892fb9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:15.631411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9a61f4ad-87fb-4f30-81c4-8ff0b892fb9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:15.632253 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9a61f4ad-87fb-4f30-81c4-8ff0b892fb9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:15.632691 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9a61f4ad-87fb-4f30-81c4-8ff0b892fb9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:15.803592 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b9fcb74a-6454-4076-bc05-da471565e584 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:15.815028 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b9fcb74a-6454-4076-bc05-da471565e584 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:15.817054 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b9fcb74a-6454-4076-bc05-da471565e584 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:15.822160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b9fcb74a-6454-4076-bc05-da471565e584 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.314405 May 09 04:29:15.827507 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 246/478] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:15 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:15.842787 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-55ba2a3c-3bb6-47c2-9810-fc331b358f46 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1421884183"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:15.843638 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-55ba2a3c-3bb6-47c2-9810-fc331b358f46 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:15.861367 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9a61f4ad-87fb-4f30-81c4-8ff0b892fb9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:15.862040 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-55ba2a3c-3bb6-47c2-9810-fc331b358f46 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:15.862893 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-55ba2a3c-3bb6-47c2-9810-fc331b358f46 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:15.864652 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-55ba2a3c-3bb6-47c2-9810-fc331b358f46 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:15.865512 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-55ba2a3c-3bb6-47c2-9810-fc331b358f46 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:15.872956 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9a61f4ad-87fb-4f30-81c4-8ff0b892fb9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.267224 May 09 04:29:15.884139 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 233/479] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:15 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:16.097756 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.network.security_group_api [None req-55ba2a3c-3bb6-47c2-9810-fc331b358f46 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Adding security group 50344f9a-eb8f-43c1-9c05-983eb3f3a838 to port 675e6f12-2f41-46e3-b8d5-09ed37ae4a6f May 09 04:29:16.494347 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-55ba2a3c-3bb6-47c2-9810-fc331b358f46 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "POST /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/action" status: 202 len: 0 microversion: 2.1 time: 0.664935 May 09 04:29:16.497998 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 247/480] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 04:29:15 2022] POST /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:29:16.506995 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6dbbddaf-7c3c-43a4-8d77-3907ce9851b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:16.507606 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6dbbddaf-7c3c-43a4-8d77-3907ce9851b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:16.513657 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-32532876-6b68-418d-9562-3d913e4bd884 req-888f405b-4ea6-4aa0-a7c4-d8a0085bf5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52cecb3-2634-4f9e-a9df-1ae4595bb3e1", "tag": "675e6f12-2f41-46e3-b8d5-09ed37ae4a6f"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:16.530513 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-32532876-6b68-418d-9562-3d913e4bd884 req-888f405b-4ea6-4aa0-a7c4-d8a0085bf5c2 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:16.531392 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6dbbddaf-7c3c-43a4-8d77-3907ce9851b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:16.532049 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6dbbddaf-7c3c-43a4-8d77-3907ce9851b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:16.532946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6dbbddaf-7c3c-43a4-8d77-3907ce9851b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:16.533350 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-32532876-6b68-418d-9562-3d913e4bd884 req-888f405b-4ea6-4aa0-a7c4-d8a0085bf5c2 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:16.536423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6dbbddaf-7c3c-43a4-8d77-3907ce9851b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:16.556584 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-32532876-6b68-418d-9562-3d913e4bd884 req-888f405b-4ea6-4aa0-a7c4-d8a0085bf5c2 service nova] Creating event network-changed:675e6f12-2f41-46e3-b8d5-09ed37ae4a6f for instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 on hv-cinder-83800 May 09 04:29:16.562587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-32532876-6b68-418d-9562-3d913e4bd884 req-888f405b-4ea6-4aa0-a7c4-d8a0085bf5c2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052405 May 09 04:29:16.564069 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 248/481] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:29:16.701853 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6dbbddaf-7c3c-43a4-8d77-3907ce9851b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:16.711660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6dbbddaf-7c3c-43a4-8d77-3907ce9851b8 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1641 microversion: 2.1 time: 0.209368 May 09 04:29:16.713177 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 234/482] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:16 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1641 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:16.846851 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-295266dd-273d-4453-a67e-d2c22f50f8a6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:16.847530 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-295266dd-273d-4453-a67e-d2c22f50f8a6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:16.855136 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-295266dd-273d-4453-a67e-d2c22f50f8a6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:16.855594 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-295266dd-273d-4453-a67e-d2c22f50f8a6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:16.856401 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-295266dd-273d-4453-a67e-d2c22f50f8a6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:16.857056 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-295266dd-273d-4453-a67e-d2c22f50f8a6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:16.893724 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2061b75a-cfbe-4621-a77e-a9bb7ac66a45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:16.894749 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2061b75a-cfbe-4621-a77e-a9bb7ac66a45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:16.916817 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2061b75a-cfbe-4621-a77e-a9bb7ac66a45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:16.917675 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2061b75a-cfbe-4621-a77e-a9bb7ac66a45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:16.918821 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2061b75a-cfbe-4621-a77e-a9bb7ac66a45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:16.919488 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2061b75a-cfbe-4621-a77e-a9bb7ac66a45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:17.025017 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-295266dd-273d-4453-a67e-d2c22f50f8a6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:17.037323 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-295266dd-273d-4453-a67e-d2c22f50f8a6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:17.038969 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-295266dd-273d-4453-a67e-d2c22f50f8a6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:17.040171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-295266dd-273d-4453-a67e-d2c22f50f8a6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.197618 May 09 04:29:17.040736 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 249/483] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:16 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:17.107657 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2061b75a-cfbe-4621-a77e-a9bb7ac66a45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:17.116226 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2061b75a-cfbe-4621-a77e-a9bb7ac66a45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.226536 May 09 04:29:17.116805 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 235/484] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:16 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:18.059288 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f07e649c-2707-422e-8caa-67c9526ff6a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:18.059964 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f07e649c-2707-422e-8caa-67c9526ff6a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:18.066257 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f07e649c-2707-422e-8caa-67c9526ff6a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:18.066714 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f07e649c-2707-422e-8caa-67c9526ff6a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:18.067681 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f07e649c-2707-422e-8caa-67c9526ff6a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:18.068196 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f07e649c-2707-422e-8caa-67c9526ff6a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:18.133080 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6d475d32-6cd7-4134-8054-5cf7cb8983a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:18.133783 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6d475d32-6cd7-4134-8054-5cf7cb8983a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:18.140414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6d475d32-6cd7-4134-8054-5cf7cb8983a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:18.141030 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6d475d32-6cd7-4134-8054-5cf7cb8983a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:18.141809 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6d475d32-6cd7-4134-8054-5cf7cb8983a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:18.142244 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6d475d32-6cd7-4134-8054-5cf7cb8983a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:18.210139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f07e649c-2707-422e-8caa-67c9526ff6a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:18.219630 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f07e649c-2707-422e-8caa-67c9526ff6a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:18.221760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f07e649c-2707-422e-8caa-67c9526ff6a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:18.222456 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f07e649c-2707-422e-8caa-67c9526ff6a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.167171 May 09 04:29:18.223193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 250/485] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:18 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:18.292834 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6d475d32-6cd7-4134-8054-5cf7cb8983a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:18.300300 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6d475d32-6cd7-4134-8054-5cf7cb8983a2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.171071 May 09 04:29:18.300878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 236/486] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:18 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:19.241805 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-de89f402-ca70-41df-b5d9-ff30eafeb79a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:19.243072 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-de89f402-ca70-41df-b5d9-ff30eafeb79a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:19.249862 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-de89f402-ca70-41df-b5d9-ff30eafeb79a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:19.250312 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-de89f402-ca70-41df-b5d9-ff30eafeb79a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:19.251085 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-de89f402-ca70-41df-b5d9-ff30eafeb79a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:19.251526 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-de89f402-ca70-41df-b5d9-ff30eafeb79a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:19.317689 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ec392b48-9edf-4085-a459-c150fe25d36a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:19.318738 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ec392b48-9edf-4085-a459-c150fe25d36a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:19.325795 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec392b48-9edf-4085-a459-c150fe25d36a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:19.326251 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec392b48-9edf-4085-a459-c150fe25d36a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:19.327033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec392b48-9edf-4085-a459-c150fe25d36a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:19.327466 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec392b48-9edf-4085-a459-c150fe25d36a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:19.400244 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-de89f402-ca70-41df-b5d9-ff30eafeb79a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:19.408931 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-de89f402-ca70-41df-b5d9-ff30eafeb79a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:19.410532 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-de89f402-ca70-41df-b5d9-ff30eafeb79a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:19.412534 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-de89f402-ca70-41df-b5d9-ff30eafeb79a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.174687 May 09 04:29:19.413469 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 251/487] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:19 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:19.471540 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ec392b48-9edf-4085-a459-c150fe25d36a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:19.480214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ec392b48-9edf-4085-a459-c150fe25d36a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.166728 May 09 04:29:19.480807 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 237/488] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:19 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:20.431419 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-74c939fc-a6d0-4eca-ad49-f38fcef8e730 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:20.433060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-74c939fc-a6d0-4eca-ad49-f38fcef8e730 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:20.439662 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-74c939fc-a6d0-4eca-ad49-f38fcef8e730 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:20.440441 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-74c939fc-a6d0-4eca-ad49-f38fcef8e730 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:20.441430 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-74c939fc-a6d0-4eca-ad49-f38fcef8e730 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:20.442082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-74c939fc-a6d0-4eca-ad49-f38fcef8e730 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:20.498506 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ae25355b-b119-4120-9c7b-8e4ddff5f96c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:20.499218 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ae25355b-b119-4120-9c7b-8e4ddff5f96c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:20.505780 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ae25355b-b119-4120-9c7b-8e4ddff5f96c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:20.506300 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ae25355b-b119-4120-9c7b-8e4ddff5f96c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:20.507142 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ae25355b-b119-4120-9c7b-8e4ddff5f96c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:20.507573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ae25355b-b119-4120-9c7b-8e4ddff5f96c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:20.638987 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-74c939fc-a6d0-4eca-ad49-f38fcef8e730 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:20.652649 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-74c939fc-a6d0-4eca-ad49-f38fcef8e730 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:20.654303 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-74c939fc-a6d0-4eca-ad49-f38fcef8e730 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:20.659124 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-74c939fc-a6d0-4eca-ad49-f38fcef8e730 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.228860 May 09 04:29:20.660117 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 252/489] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:20 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:20.679736 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ae25355b-b119-4120-9c7b-8e4ddff5f96c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:20.687290 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ae25355b-b119-4120-9c7b-8e4ddff5f96c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.192616 May 09 04:29:20.687877 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 238/490] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:20 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:21.678029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-270ea4d5-45e9-452e-a417-c253223c6efa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:21.678632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-270ea4d5-45e9-452e-a417-c253223c6efa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:21.685989 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-270ea4d5-45e9-452e-a417-c253223c6efa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:21.686511 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-270ea4d5-45e9-452e-a417-c253223c6efa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:21.687301 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-270ea4d5-45e9-452e-a417-c253223c6efa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:21.687742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-270ea4d5-45e9-452e-a417-c253223c6efa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:21.705593 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c31b993c-dab7-4e92-8ab5-46ddd58518c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:21.706204 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c31b993c-dab7-4e92-8ab5-46ddd58518c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:21.723629 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c31b993c-dab7-4e92-8ab5-46ddd58518c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:21.724176 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c31b993c-dab7-4e92-8ab5-46ddd58518c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:21.724992 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c31b993c-dab7-4e92-8ab5-46ddd58518c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:21.727344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c31b993c-dab7-4e92-8ab5-46ddd58518c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:21.847310 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-270ea4d5-45e9-452e-a417-c253223c6efa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:21.856720 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-270ea4d5-45e9-452e-a417-c253223c6efa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:21.858246 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-270ea4d5-45e9-452e-a417-c253223c6efa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:21.859538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-270ea4d5-45e9-452e-a417-c253223c6efa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.185341 May 09 04:29:21.870851 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 253/491] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:21 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:21.875928 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c31b993c-dab7-4e92-8ab5-46ddd58518c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:21.885376 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c31b993c-dab7-4e92-8ab5-46ddd58518c9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.184015 May 09 04:29:21.885952 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 239/492] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:21 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:22.879454 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8ec8daa7-18f1-441c-9f57-bd8e4049a80f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:22.881406 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8ec8daa7-18f1-441c-9f57-bd8e4049a80f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:22.890465 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8ec8daa7-18f1-441c-9f57-bd8e4049a80f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:22.891244 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8ec8daa7-18f1-441c-9f57-bd8e4049a80f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:22.892066 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8ec8daa7-18f1-441c-9f57-bd8e4049a80f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:22.892502 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8ec8daa7-18f1-441c-9f57-bd8e4049a80f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:22.903107 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-28b62618-7a7e-4caf-91b0-b056815a6fe1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:22.903765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-28b62618-7a7e-4caf-91b0-b056815a6fe1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:22.910250 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28b62618-7a7e-4caf-91b0-b056815a6fe1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:22.910702 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28b62618-7a7e-4caf-91b0-b056815a6fe1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:22.911471 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28b62618-7a7e-4caf-91b0-b056815a6fe1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:22.911919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28b62618-7a7e-4caf-91b0-b056815a6fe1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:23.046382 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8ec8daa7-18f1-441c-9f57-bd8e4049a80f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:23.055383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8ec8daa7-18f1-441c-9f57-bd8e4049a80f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:23.058546 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8ec8daa7-18f1-441c-9f57-bd8e4049a80f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:23.059866 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8ec8daa7-18f1-441c-9f57-bd8e4049a80f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.185343 May 09 04:29:23.060927 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 254/493] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:22 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:23.068143 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-28b62618-7a7e-4caf-91b0-b056815a6fe1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:23.075633 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-28b62618-7a7e-4caf-91b0-b056815a6fe1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.177135 May 09 04:29:23.076243 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 240/494] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:22 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:24.078815 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1280e320-4f03-400c-8a0c-a598a1c6a1a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:24.079468 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1280e320-4f03-400c-8a0c-a598a1c6a1a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:24.085891 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1280e320-4f03-400c-8a0c-a598a1c6a1a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:24.086329 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1280e320-4f03-400c-8a0c-a598a1c6a1a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:24.087926 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1280e320-4f03-400c-8a0c-a598a1c6a1a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:24.088756 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1280e320-4f03-400c-8a0c-a598a1c6a1a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:24.094261 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7aaf678c-7d5a-47d2-998d-fcb0ab74dca4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:24.094948 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7aaf678c-7d5a-47d2-998d-fcb0ab74dca4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:24.101792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7aaf678c-7d5a-47d2-998d-fcb0ab74dca4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:24.102481 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7aaf678c-7d5a-47d2-998d-fcb0ab74dca4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:24.104111 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7aaf678c-7d5a-47d2-998d-fcb0ab74dca4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:24.104550 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7aaf678c-7d5a-47d2-998d-fcb0ab74dca4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:24.237865 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1280e320-4f03-400c-8a0c-a598a1c6a1a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:24.247052 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1280e320-4f03-400c-8a0c-a598a1c6a1a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:24.248622 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1280e320-4f03-400c-8a0c-a598a1c6a1a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:24.250042 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1280e320-4f03-400c-8a0c-a598a1c6a1a2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.175580 May 09 04:29:24.261380 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 255/495] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:24 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:24.263484 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7aaf678c-7d5a-47d2-998d-fcb0ab74dca4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:24.271035 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7aaf678c-7d5a-47d2-998d-fcb0ab74dca4 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.181000 May 09 04:29:24.271816 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 241/496] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:24 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:25.268343 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-861ac2c0-3045-44c3-8b9a-5c02a76a5aa1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:25.269065 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-861ac2c0-3045-44c3-8b9a-5c02a76a5aa1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:25.276196 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-861ac2c0-3045-44c3-8b9a-5c02a76a5aa1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:25.276660 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-861ac2c0-3045-44c3-8b9a-5c02a76a5aa1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:25.277494 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-861ac2c0-3045-44c3-8b9a-5c02a76a5aa1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:25.277936 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-861ac2c0-3045-44c3-8b9a-5c02a76a5aa1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:25.288832 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-940f48e3-fbc1-4595-aae4-406715dbb09f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:25.289442 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-940f48e3-fbc1-4595-aae4-406715dbb09f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:25.295938 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-940f48e3-fbc1-4595-aae4-406715dbb09f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:25.296397 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-940f48e3-fbc1-4595-aae4-406715dbb09f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:25.297159 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-940f48e3-fbc1-4595-aae4-406715dbb09f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:25.297601 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-940f48e3-fbc1-4595-aae4-406715dbb09f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:25.425983 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-861ac2c0-3045-44c3-8b9a-5c02a76a5aa1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:25.436170 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-861ac2c0-3045-44c3-8b9a-5c02a76a5aa1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:25.439375 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-861ac2c0-3045-44c3-8b9a-5c02a76a5aa1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:25.440848 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-861ac2c0-3045-44c3-8b9a-5c02a76a5aa1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.176410 May 09 04:29:25.441626 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 256/497] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:25 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:25.441757 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-940f48e3-fbc1-4595-aae4-406715dbb09f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:25.449440 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-940f48e3-fbc1-4595-aae4-406715dbb09f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.164542 May 09 04:29:25.449996 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 242/498] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:25 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:26.459138 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-78e0898a-6a3e-4e57-ad3b-d784eb21ef6b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:26.459857 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-78e0898a-6a3e-4e57-ad3b-d784eb21ef6b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:26.466449 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3b8d54de-a3c3-4b4a-9057-741d01709242 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:26.467447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-78e0898a-6a3e-4e57-ad3b-d784eb21ef6b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:26.467676 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3b8d54de-a3c3-4b4a-9057-741d01709242 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:26.467921 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-78e0898a-6a3e-4e57-ad3b-d784eb21ef6b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:26.468702 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-78e0898a-6a3e-4e57-ad3b-d784eb21ef6b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:26.469140 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-78e0898a-6a3e-4e57-ad3b-d784eb21ef6b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:26.474278 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b8d54de-a3c3-4b4a-9057-741d01709242 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:26.474732 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b8d54de-a3c3-4b4a-9057-741d01709242 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:26.475495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b8d54de-a3c3-4b4a-9057-741d01709242 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:26.475945 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b8d54de-a3c3-4b4a-9057-741d01709242 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:26.616673 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3b8d54de-a3c3-4b4a-9057-741d01709242 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:26.624611 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3b8d54de-a3c3-4b4a-9057-741d01709242 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.161832 May 09 04:29:26.625323 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 243/499] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:26 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:26.626973 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-78e0898a-6a3e-4e57-ad3b-d784eb21ef6b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:26.637061 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-78e0898a-6a3e-4e57-ad3b-d784eb21ef6b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:26.638575 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-78e0898a-6a3e-4e57-ad3b-d784eb21ef6b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:26.639743 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-78e0898a-6a3e-4e57-ad3b-d784eb21ef6b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.184506 May 09 04:29:26.640346 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 257/500] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:26 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:27.641326 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3913dfa4-f01e-4bf9-aec7-44c12107f005 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:27.642031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3913dfa4-f01e-4bf9-aec7-44c12107f005 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:27.648786 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3913dfa4-f01e-4bf9-aec7-44c12107f005 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:27.649234 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3913dfa4-f01e-4bf9-aec7-44c12107f005 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:27.650013 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3913dfa4-f01e-4bf9-aec7-44c12107f005 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:27.650442 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3913dfa4-f01e-4bf9-aec7-44c12107f005 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:27.659580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-38ef4a6b-0b40-4c07-a0f5-940175e831a4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:27.660950 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-38ef4a6b-0b40-4c07-a0f5-940175e831a4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:27.668118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-38ef4a6b-0b40-4c07-a0f5-940175e831a4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:27.669017 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-38ef4a6b-0b40-4c07-a0f5-940175e831a4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:27.669893 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-38ef4a6b-0b40-4c07-a0f5-940175e831a4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:27.670395 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-38ef4a6b-0b40-4c07-a0f5-940175e831a4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:27.793681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3913dfa4-f01e-4bf9-aec7-44c12107f005 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:27.801076 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3913dfa4-f01e-4bf9-aec7-44c12107f005 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.163664 May 09 04:29:27.801653 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 244/501] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:27 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:27.817642 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-38ef4a6b-0b40-4c07-a0f5-940175e831a4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:27.826122 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-38ef4a6b-0b40-4c07-a0f5-940175e831a4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:27.827598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-38ef4a6b-0b40-4c07-a0f5-940175e831a4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:27.829023 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-38ef4a6b-0b40-4c07-a0f5-940175e831a4 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.174463 May 09 04:29:27.829584 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 258/502] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:27 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:29:28.818289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5c5770bf-c61d-46b5-9b99-be7509df3eb7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:28.819035 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5c5770bf-c61d-46b5-9b99-be7509df3eb7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:28.826505 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5c5770bf-c61d-46b5-9b99-be7509df3eb7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:28.826957 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5c5770bf-c61d-46b5-9b99-be7509df3eb7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:28.827734 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5c5770bf-c61d-46b5-9b99-be7509df3eb7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:28.828205 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5c5770bf-c61d-46b5-9b99-be7509df3eb7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:28.848725 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-aea02f1a-4d8d-4d17-9594-cc976c08e0e2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:28.849328 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-aea02f1a-4d8d-4d17-9594-cc976c08e0e2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:28.856380 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aea02f1a-4d8d-4d17-9594-cc976c08e0e2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:28.856821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aea02f1a-4d8d-4d17-9594-cc976c08e0e2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:28.857578 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aea02f1a-4d8d-4d17-9594-cc976c08e0e2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:28.858007 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aea02f1a-4d8d-4d17-9594-cc976c08e0e2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:28.963934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5c5770bf-c61d-46b5-9b99-be7509df3eb7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:28.970745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5c5770bf-c61d-46b5-9b99-be7509df3eb7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1370 microversion: 2.1 time: 0.156386 May 09 04:29:28.971328 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 245/503] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:28 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:28.990202 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-aea02f1a-4d8d-4d17-9594-cc976c08e0e2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:28.999369 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-aea02f1a-4d8d-4d17-9594-cc976c08e0e2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:29.001143 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-aea02f1a-4d8d-4d17-9594-cc976c08e0e2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:29.002378 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-aea02f1a-4d8d-4d17-9594-cc976c08e0e2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.157418 May 09 04:29:29.002968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 259/504] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:28 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:29:29.988350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a66d28bb-3327-48c6-832b-fe30ccdab036 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:29.988957 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a66d28bb-3327-48c6-832b-fe30ccdab036 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:29.996129 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a66d28bb-3327-48c6-832b-fe30ccdab036 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:29.996578 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a66d28bb-3327-48c6-832b-fe30ccdab036 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:29.997333 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a66d28bb-3327-48c6-832b-fe30ccdab036 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:29.997765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a66d28bb-3327-48c6-832b-fe30ccdab036 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:30.022853 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-878e763a-4c05-4622-8667-3a7a0bde67fb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:30.023380 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-878e763a-4c05-4622-8667-3a7a0bde67fb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:30.029455 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-878e763a-4c05-4622-8667-3a7a0bde67fb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:30.029900 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-878e763a-4c05-4622-8667-3a7a0bde67fb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:30.030659 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-878e763a-4c05-4622-8667-3a7a0bde67fb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:30.031093 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-878e763a-4c05-4622-8667-3a7a0bde67fb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:30.127646 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a66d28bb-3327-48c6-832b-fe30ccdab036 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:30.135791 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a66d28bb-3327-48c6-832b-fe30ccdab036 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1565 microversion: 2.1 time: 0.151261 May 09 04:29:30.136749 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 246/505] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:29 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:30.152305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fc4ac799-59c9-47d5-9044-692990549b49 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:30.152801 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fc4ac799-59c9-47d5-9044-692990549b49 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:30.158690 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fc4ac799-59c9-47d5-9044-692990549b49 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:30.159136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fc4ac799-59c9-47d5-9044-692990549b49 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:30.159934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fc4ac799-59c9-47d5-9044-692990549b49 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:30.160431 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fc4ac799-59c9-47d5-9044-692990549b49 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:30.166093 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-878e763a-4c05-4622-8667-3a7a0bde67fb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:30.175652 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-878e763a-4c05-4622-8667-3a7a0bde67fb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:30.177183 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-878e763a-4c05-4622-8667-3a7a0bde67fb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:30.178362 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-878e763a-4c05-4622-8667-3a7a0bde67fb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.161452 May 09 04:29:30.179134 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 260/506] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:30 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:29:30.240248 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fc4ac799-59c9-47d5-9044-692990549b49 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091922 May 09 04:29:30.240864 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 247/507] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 04:29:30 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:29:30.343610 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ef4287d5-1745-407e-8e78-10f0b3c81dfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:30.344146 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ef4287d5-1745-407e-8e78-10f0b3c81dfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:30.351348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ef4287d5-1745-407e-8e78-10f0b3c81dfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:30.351796 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ef4287d5-1745-407e-8e78-10f0b3c81dfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:30.353812 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ef4287d5-1745-407e-8e78-10f0b3c81dfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:30.355021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ef4287d5-1745-407e-8e78-10f0b3c81dfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:30.384183 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ef4287d5-1745-407e-8e78-10f0b3c81dfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887/ips" status: 200 len: 150 microversion: 2.1 time: 0.044351 May 09 04:29:30.384995 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 261/508] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 04:29:30 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:31.198421 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-94c283f0-ffb4-4e80-b9e4-9a4fc9b9a6bb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:31.199362 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-94c283f0-ffb4-4e80-b9e4-9a4fc9b9a6bb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:31.206532 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94c283f0-ffb4-4e80-b9e4-9a4fc9b9a6bb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:31.207041 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94c283f0-ffb4-4e80-b9e4-9a4fc9b9a6bb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:31.208071 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94c283f0-ffb4-4e80-b9e4-9a4fc9b9a6bb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:31.208690 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94c283f0-ffb4-4e80-b9e4-9a4fc9b9a6bb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:31.573937 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-94c283f0-ffb4-4e80-b9e4-9a4fc9b9a6bb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:31.583107 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-94c283f0-ffb4-4e80-b9e4-9a4fc9b9a6bb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:31.584855 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-94c283f0-ffb4-4e80-b9e4-9a4fc9b9a6bb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:31.586246 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-94c283f0-ffb4-4e80-b9e4-9a4fc9b9a6bb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.391976 May 09 04:29:31.587138 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 248/509] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:31 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:31.753684 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e72f6377-04e7-4589-b3ad-383513e93198 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f50c905b-b019-4ab6-aed6-9e06f04287b8"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:31.755618 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e72f6377-04e7-4589-b3ad-383513e93198 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:31.764851 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e72f6377-04e7-4589-b3ad-383513e93198 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:31.765478 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e72f6377-04e7-4589-b3ad-383513e93198 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:31.766420 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e72f6377-04e7-4589-b3ad-383513e93198 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:31.766851 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e72f6377-04e7-4589-b3ad-383513e93198 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:31.815361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-ee7de6ba-8b3e-453e-8a03-9a7229303dd2 req-2c27ed26-7470-4acc-8f54-b08b12e6fd9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4473a2d0-b3cc-401b-b460-7c00c66893a0", "tag": "ef4e419e-4415-4b7c-b72d-4dbd68f98b15"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:31.825374 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-ee7de6ba-8b3e-453e-8a03-9a7229303dd2 req-2c27ed26-7470-4acc-8f54-b08b12e6fd9d service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:31.827634 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-ee7de6ba-8b3e-453e-8a03-9a7229303dd2 req-2c27ed26-7470-4acc-8f54-b08b12e6fd9d service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:31.841644 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-ee7de6ba-8b3e-453e-8a03-9a7229303dd2 req-2c27ed26-7470-4acc-8f54-b08b12e6fd9d service nova] Creating event network-changed:ef4e419e-4415-4b7c-b72d-4dbd68f98b15 for instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 on hv-cinder-83800 May 09 04:29:31.847430 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-ee7de6ba-8b3e-453e-8a03-9a7229303dd2 req-2c27ed26-7470-4acc-8f54-b08b12e6fd9d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035846 May 09 04:29:31.848776 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 249/510] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:32.163721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e72f6377-04e7-4589-b3ad-383513e93198 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "POST /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413805 May 09 04:29:32.164906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 262/511] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 04:29:31 2022] POST /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:32.606330 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ace46d73-2bae-47ab-b92a-dcad4e063ca6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:32.607021 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ace46d73-2bae-47ab-b92a-dcad4e063ca6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:32.613343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ace46d73-2bae-47ab-b92a-dcad4e063ca6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:32.613788 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ace46d73-2bae-47ab-b92a-dcad4e063ca6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:32.614544 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ace46d73-2bae-47ab-b92a-dcad4e063ca6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:32.614977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ace46d73-2bae-47ab-b92a-dcad4e063ca6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:32.840215 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ace46d73-2bae-47ab-b92a-dcad4e063ca6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:32.849175 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ace46d73-2bae-47ab-b92a-dcad4e063ca6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:32.850898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ace46d73-2bae-47ab-b92a-dcad4e063ca6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:32.852080 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ace46d73-2bae-47ab-b92a-dcad4e063ca6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.251211 May 09 04:29:32.853520 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 250/512] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:32 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:33.871757 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-38cc7ca7-3122-48e4-9d41-cd35277a4c22 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:33.872497 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-38cc7ca7-3122-48e4-9d41-cd35277a4c22 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:33.878752 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-38cc7ca7-3122-48e4-9d41-cd35277a4c22 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:33.879200 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-38cc7ca7-3122-48e4-9d41-cd35277a4c22 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:33.879993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-38cc7ca7-3122-48e4-9d41-cd35277a4c22 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:33.880436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-38cc7ca7-3122-48e4-9d41-cd35277a4c22 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:34.006841 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-38cc7ca7-3122-48e4-9d41-cd35277a4c22 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:34.015782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-38cc7ca7-3122-48e4-9d41-cd35277a4c22 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:34.017239 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-38cc7ca7-3122-48e4-9d41-cd35277a4c22 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:34.018393 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-38cc7ca7-3122-48e4-9d41-cd35277a4c22 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.151456 May 09 04:29:34.018989 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 263/513] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:33 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:35.036509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dae81144-f957-40b1-8cec-2b97a2748b65 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:35.037067 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dae81144-f957-40b1-8cec-2b97a2748b65 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:35.043388 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dae81144-f957-40b1-8cec-2b97a2748b65 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:35.043830 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dae81144-f957-40b1-8cec-2b97a2748b65 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:35.044607 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dae81144-f957-40b1-8cec-2b97a2748b65 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:35.045034 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dae81144-f957-40b1-8cec-2b97a2748b65 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:35.174868 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dae81144-f957-40b1-8cec-2b97a2748b65 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:35.183860 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dae81144-f957-40b1-8cec-2b97a2748b65 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:35.185359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dae81144-f957-40b1-8cec-2b97a2748b65 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:35.186507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dae81144-f957-40b1-8cec-2b97a2748b65 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.153917 May 09 04:29:35.187079 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 251/514] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:35 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:36.205030 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-709f79b4-d452-4d7b-b777-6eeed3e27af9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:36.205570 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-709f79b4-d452-4d7b-b777-6eeed3e27af9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:36.211657 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-709f79b4-d452-4d7b-b777-6eeed3e27af9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:36.212412 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-709f79b4-d452-4d7b-b777-6eeed3e27af9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:36.213180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-709f79b4-d452-4d7b-b777-6eeed3e27af9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:36.214263 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-709f79b4-d452-4d7b-b777-6eeed3e27af9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:36.340992 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-709f79b4-d452-4d7b-b777-6eeed3e27af9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:36.349247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-709f79b4-d452-4d7b-b777-6eeed3e27af9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:36.350720 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-709f79b4-d452-4d7b-b777-6eeed3e27af9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:36.351909 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-709f79b4-d452-4d7b-b777-6eeed3e27af9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.151026 May 09 04:29:36.352471 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 264/515] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:36 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:37.371402 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8d0b9911-7b60-4ac2-bbf6-6a9acd2d9727 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:37.372094 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8d0b9911-7b60-4ac2-bbf6-6a9acd2d9727 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:37.378505 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8d0b9911-7b60-4ac2-bbf6-6a9acd2d9727 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:37.378954 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8d0b9911-7b60-4ac2-bbf6-6a9acd2d9727 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:37.379716 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8d0b9911-7b60-4ac2-bbf6-6a9acd2d9727 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:37.380190 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8d0b9911-7b60-4ac2-bbf6-6a9acd2d9727 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:37.506322 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8d0b9911-7b60-4ac2-bbf6-6a9acd2d9727 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:37.514841 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8d0b9911-7b60-4ac2-bbf6-6a9acd2d9727 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:37.516380 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8d0b9911-7b60-4ac2-bbf6-6a9acd2d9727 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:37.517534 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8d0b9911-7b60-4ac2-bbf6-6a9acd2d9727 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.151278 May 09 04:29:37.518092 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 252/516] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:37 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:38.536262 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8409e180-ac19-4c31-9cb5-31f7064a8e5c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:38.536875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8409e180-ac19-4c31-9cb5-31f7064a8e5c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:38.543186 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8409e180-ac19-4c31-9cb5-31f7064a8e5c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:38.543637 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8409e180-ac19-4c31-9cb5-31f7064a8e5c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:38.544577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8409e180-ac19-4c31-9cb5-31f7064a8e5c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:38.545002 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8409e180-ac19-4c31-9cb5-31f7064a8e5c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:38.673360 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8409e180-ac19-4c31-9cb5-31f7064a8e5c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:38.681606 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8409e180-ac19-4c31-9cb5-31f7064a8e5c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:38.683861 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8409e180-ac19-4c31-9cb5-31f7064a8e5c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:38.685062 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8409e180-ac19-4c31-9cb5-31f7064a8e5c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.152653 May 09 04:29:38.685619 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 265/517] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:38 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:39.702924 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4247fe61-2498-47a3-bd05-78c1d7c48478 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:39.704166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4247fe61-2498-47a3-bd05-78c1d7c48478 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:39.710594 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4247fe61-2498-47a3-bd05-78c1d7c48478 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:39.711043 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4247fe61-2498-47a3-bd05-78c1d7c48478 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:39.711808 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4247fe61-2498-47a3-bd05-78c1d7c48478 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:39.712527 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4247fe61-2498-47a3-bd05-78c1d7c48478 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:39.854421 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4247fe61-2498-47a3-bd05-78c1d7c48478 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:39.862786 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4247fe61-2498-47a3-bd05-78c1d7c48478 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:39.864311 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4247fe61-2498-47a3-bd05-78c1d7c48478 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:39.865462 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4247fe61-2498-47a3-bd05-78c1d7c48478 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.166503 May 09 04:29:39.866055 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 253/518] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:39 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:40.687707 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-aa3e53b7-cbe0-416f-9e45-bf08767f2a5a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Action: 'create', calling method: .version_select at 0x7fbfd4681820>, body: {"keypair": {"name": "tempest-keypair-249584293"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:40.702237 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-aa3e53b7-cbe0-416f-9e45-bf08767f2a5a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:29:40.705944 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-aa3e53b7-cbe0-416f-9e45-bf08767f2a5a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for user c56a403eeee84720ba765e2d4367df74 and project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:29:40.884266 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dbc99a4b-dec0-4e79-9408-687f95efeaeb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:40.884810 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dbc99a4b-dec0-4e79-9408-687f95efeaeb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:40.891390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dbc99a4b-dec0-4e79-9408-687f95efeaeb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:40.891838 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dbc99a4b-dec0-4e79-9408-687f95efeaeb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:40.892776 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dbc99a4b-dec0-4e79-9408-687f95efeaeb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:40.893210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dbc99a4b-dec0-4e79-9408-687f95efeaeb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:41.023294 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dbc99a4b-dec0-4e79-9408-687f95efeaeb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:41.031643 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dbc99a4b-dec0-4e79-9408-687f95efeaeb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:41.033173 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dbc99a4b-dec0-4e79-9408-687f95efeaeb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:41.034315 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dbc99a4b-dec0-4e79-9408-687f95efeaeb tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.154190 May 09 04:29:41.034873 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 254/519] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:40 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:29:41.161168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-aa3e53b7-cbe0-416f-9e45-bf08767f2a5a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:29:41.164707 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-aa3e53b7-cbe0-416f-9e45-bf08767f2a5a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for user c56a403eeee84720ba765e2d4367df74 and project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:29:41.177651 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-aa3e53b7-cbe0-416f-9e45-bf08767f2a5a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.493727 May 09 04:29:41.178237 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 266/520] 10.222.0.44 () {60 vars in 1157 bytes} [Mon May 9 04:29:40 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:41.737484 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-23c5ca10-0811-425a-bf02-9198c4782c84 req-714a2177-753d-4e10-9c5e-3861921e52e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d10350c6-bf15-414f-9bf7-d371b6912be2", "name": "network-vif-plugged", "status": "completed", "tag": "2abd51b8-3b37-4ec3-841e-462a68eb5cbc"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:41.759626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-23c5ca10-0811-425a-bf02-9198c4782c84 req-714a2177-753d-4e10-9c5e-3861921e52e4 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:41.760640 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-23c5ca10-0811-425a-bf02-9198c4782c84 req-714a2177-753d-4e10-9c5e-3861921e52e4 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:41.773336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-23c5ca10-0811-425a-bf02-9198c4782c84 req-714a2177-753d-4e10-9c5e-3861921e52e4 service nova] Creating event network-vif-plugged:2abd51b8-3b37-4ec3-841e-462a68eb5cbc for instance d10350c6-bf15-414f-9bf7-d371b6912be2 on hv-cinder-83800 May 09 04:29:41.778905 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-23c5ca10-0811-425a-bf02-9198c4782c84 req-714a2177-753d-4e10-9c5e-3861921e52e4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045087 May 09 04:29:41.779732 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 255/521] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:42.054025 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c2235881-b7c6-49df-bd8c-286e18bbc419 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:42.054693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c2235881-b7c6-49df-bd8c-286e18bbc419 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:42.061341 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c2235881-b7c6-49df-bd8c-286e18bbc419 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:42.061878 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c2235881-b7c6-49df-bd8c-286e18bbc419 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:42.062744 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c2235881-b7c6-49df-bd8c-286e18bbc419 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:42.063250 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c2235881-b7c6-49df-bd8c-286e18bbc419 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:42.285512 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c2235881-b7c6-49df-bd8c-286e18bbc419 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:42.296602 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c2235881-b7c6-49df-bd8c-286e18bbc419 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:42.298283 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c2235881-b7c6-49df-bd8c-286e18bbc419 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:42.299685 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c2235881-b7c6-49df-bd8c-286e18bbc419 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.250335 May 09 04:29:42.300281 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 267/522] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:42 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:42.417197 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-384865209", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cff1ca97-0d5c-4d7d-b3c2-a81f844b16da"}], "security_groups": [{"name": "tempest-securitygroup--1057817192"}], "key_name": "tempest-keypair-249584293", "user_data": "}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:42.522545 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] validate_networks() for [('cff1ca97-0d5c-4d7d-b3c2-a81f844b16da', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:29:42.878385 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:29:42.878804 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:29:42.879307 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:29:42.879712 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:29:42.880153 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:29:42.889052 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:42.889533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:42.890334 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:42.890772 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:42.907614 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:29:42.911548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for user c56a403eeee84720ba765e2d4367df74 and project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:29:42.922962 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:29:42.925342 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:29:42.971164 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e4ff4b7c-4cae-472a-a401-20285d319994 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.559205 May 09 04:29:42.971815 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 256/523] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:29:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:29:42.982413 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8b189cc8-4a03-4ba6-89bc-72d5dc3378f6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:42.983105 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8b189cc8-4a03-4ba6-89bc-72d5dc3378f6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:43.042425 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8b189cc8-4a03-4ba6-89bc-72d5dc3378f6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:43.048905 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8b189cc8-4a03-4ba6-89bc-72d5dc3378f6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1240 microversion: 2.1 time: 0.071146 May 09 04:29:43.049474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 268/524] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:42 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:43.318779 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f2cebee9-91a6-4d31-897c-bacd005e58e5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:43.319380 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f2cebee9-91a6-4d31-897c-bacd005e58e5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:43.326196 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2cebee9-91a6-4d31-897c-bacd005e58e5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:43.326645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2cebee9-91a6-4d31-897c-bacd005e58e5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:43.327391 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2cebee9-91a6-4d31-897c-bacd005e58e5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:43.327818 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2cebee9-91a6-4d31-897c-bacd005e58e5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:43.461329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f2cebee9-91a6-4d31-897c-bacd005e58e5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:43.470677 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f2cebee9-91a6-4d31-897c-bacd005e58e5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:43.472229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f2cebee9-91a6-4d31-897c-bacd005e58e5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:43.473382 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f2cebee9-91a6-4d31-897c-bacd005e58e5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.158906 May 09 04:29:43.473943 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 257/525] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:43 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:44.065986 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5cb2180d-e5cc-4776-be26-e9d38c74cafa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:44.066509 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5cb2180d-e5cc-4776-be26-e9d38c74cafa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:44.073579 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5cb2180d-e5cc-4776-be26-e9d38c74cafa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:44.074026 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5cb2180d-e5cc-4776-be26-e9d38c74cafa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:44.074790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5cb2180d-e5cc-4776-be26-e9d38c74cafa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:44.075234 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5cb2180d-e5cc-4776-be26-e9d38c74cafa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:44.135460 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5cb2180d-e5cc-4776-be26-e9d38c74cafa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:44.142876 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5cb2180d-e5cc-4776-be26-e9d38c74cafa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1292 microversion: 2.1 time: 0.080790 May 09 04:29:44.143448 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 269/526] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:44 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1292 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:44.492916 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1bce69b0-c10c-4f92-8338-f4ad3189af94 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:44.494835 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1bce69b0-c10c-4f92-8338-f4ad3189af94 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:44.501112 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1bce69b0-c10c-4f92-8338-f4ad3189af94 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:44.501551 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1bce69b0-c10c-4f92-8338-f4ad3189af94 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:44.502308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1bce69b0-c10c-4f92-8338-f4ad3189af94 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:44.502734 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1bce69b0-c10c-4f92-8338-f4ad3189af94 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:44.635049 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1bce69b0-c10c-4f92-8338-f4ad3189af94 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:44.643953 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1bce69b0-c10c-4f92-8338-f4ad3189af94 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:44.645535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1bce69b0-c10c-4f92-8338-f4ad3189af94 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:44.646780 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1bce69b0-c10c-4f92-8338-f4ad3189af94 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1808 microversion: 2.20 time: 0.157659 May 09 04:29:44.647177 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 258/527] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:44 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:45.160657 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-64b45b81-ac6e-4d70-815b-ede5088084a1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:45.161259 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-64b45b81-ac6e-4d70-815b-ede5088084a1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:45.167747 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-64b45b81-ac6e-4d70-815b-ede5088084a1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:45.168223 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-64b45b81-ac6e-4d70-815b-ede5088084a1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:45.168974 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-64b45b81-ac6e-4d70-815b-ede5088084a1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:45.169403 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-64b45b81-ac6e-4d70-815b-ede5088084a1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:45.231426 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-64b45b81-ac6e-4d70-815b-ede5088084a1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:45.238695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-64b45b81-ac6e-4d70-815b-ede5088084a1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1300 microversion: 2.1 time: 0.081883 May 09 04:29:45.239269 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 270/528] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:45 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1300 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:45.664829 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3ed5321c-5de1-40b2-9e02-2fc91cb1baa8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:45.665433 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3ed5321c-5de1-40b2-9e02-2fc91cb1baa8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:45.672407 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3ed5321c-5de1-40b2-9e02-2fc91cb1baa8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:45.672857 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3ed5321c-5de1-40b2-9e02-2fc91cb1baa8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:45.673623 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3ed5321c-5de1-40b2-9e02-2fc91cb1baa8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:45.674053 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3ed5321c-5de1-40b2-9e02-2fc91cb1baa8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:45.866909 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3ed5321c-5de1-40b2-9e02-2fc91cb1baa8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:45.875698 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3ed5321c-5de1-40b2-9e02-2fc91cb1baa8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:45.877294 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3ed5321c-5de1-40b2-9e02-2fc91cb1baa8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:45.878514 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3ed5321c-5de1-40b2-9e02-2fc91cb1baa8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1795 microversion: 2.20 time: 0.217522 May 09 04:29:45.879086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 259/529] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:29:45 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1795 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:29:46.256711 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b04807e7-23cb-4fee-876d-06f7fb22c37b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:46.257336 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b04807e7-23cb-4fee-876d-06f7fb22c37b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:46.264539 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b04807e7-23cb-4fee-876d-06f7fb22c37b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:46.264995 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b04807e7-23cb-4fee-876d-06f7fb22c37b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:46.265815 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b04807e7-23cb-4fee-876d-06f7fb22c37b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:46.266255 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b04807e7-23cb-4fee-876d-06f7fb22c37b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:46.409308 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b04807e7-23cb-4fee-876d-06f7fb22c37b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:46.417854 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b04807e7-23cb-4fee-876d-06f7fb22c37b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1366 microversion: 2.1 time: 0.164892 May 09 04:29:46.418429 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 271/530] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:46 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:46.890370 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-f0dfed03-10f7-46d3-99a8-b0db23724354 req-d35ff05d-b01d-46db-9840-bc5224f602bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42b820f-fd46-4c3a-bbef-65871250c13d", "tag": "e9b357da-dcf1-479a-8514-427749cafd62"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:46.901962 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-f0dfed03-10f7-46d3-99a8-b0db23724354 req-d35ff05d-b01d-46db-9840-bc5224f602bb service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:46.902448 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-f0dfed03-10f7-46d3-99a8-b0db23724354 req-d35ff05d-b01d-46db-9840-bc5224f602bb service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:46.925838 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-f0dfed03-10f7-46d3-99a8-b0db23724354 req-d35ff05d-b01d-46db-9840-bc5224f602bb service nova] Creating event network-changed:e9b357da-dcf1-479a-8514-427749cafd62 for instance c42b820f-fd46-4c3a-bbef-65871250c13d on hv-cinder-83800 May 09 04:29:46.930883 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-f0dfed03-10f7-46d3-99a8-b0db23724354 req-d35ff05d-b01d-46db-9840-bc5224f602bb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045057 May 09 04:29:46.933073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 260/531] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:47.434976 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ff0e8a28-dad3-4749-8dcc-3130f0a43116 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:47.435507 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ff0e8a28-dad3-4749-8dcc-3130f0a43116 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:47.441900 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ff0e8a28-dad3-4749-8dcc-3130f0a43116 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:47.442346 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ff0e8a28-dad3-4749-8dcc-3130f0a43116 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:47.443102 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ff0e8a28-dad3-4749-8dcc-3130f0a43116 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:47.443535 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ff0e8a28-dad3-4749-8dcc-3130f0a43116 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:47.570417 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ff0e8a28-dad3-4749-8dcc-3130f0a43116 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:47.579289 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ff0e8a28-dad3-4749-8dcc-3130f0a43116 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1366 microversion: 2.1 time: 0.148249 May 09 04:29:47.579877 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 272/532] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:47 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:48.598028 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f9ee1804-aed4-460e-8172-1de002cb5897 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:48.598728 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f9ee1804-aed4-460e-8172-1de002cb5897 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:48.605885 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f9ee1804-aed4-460e-8172-1de002cb5897 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:48.606333 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f9ee1804-aed4-460e-8172-1de002cb5897 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:48.607095 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f9ee1804-aed4-460e-8172-1de002cb5897 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:48.607533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f9ee1804-aed4-460e-8172-1de002cb5897 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:48.743606 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f9ee1804-aed4-460e-8172-1de002cb5897 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:48.751022 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f9ee1804-aed4-460e-8172-1de002cb5897 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1366 microversion: 2.1 time: 0.157496 May 09 04:29:48.751585 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 261/533] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:48 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:49.767726 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-42a3d75f-d01b-4163-a778-b953e44da7be tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:49.768539 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-42a3d75f-d01b-4163-a778-b953e44da7be tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:49.776020 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-42a3d75f-d01b-4163-a778-b953e44da7be tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:49.777565 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-42a3d75f-d01b-4163-a778-b953e44da7be tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:49.778694 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-42a3d75f-d01b-4163-a778-b953e44da7be tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:49.779236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-42a3d75f-d01b-4163-a778-b953e44da7be tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:49.912397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-42a3d75f-d01b-4163-a778-b953e44da7be tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:49.920309 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-42a3d75f-d01b-4163-a778-b953e44da7be tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1366 microversion: 2.1 time: 0.156349 May 09 04:29:49.920880 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 273/534] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:49 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:50.937602 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-79613ca2-f89d-4fa1-b191-1a53ee28e769 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:50.938136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-79613ca2-f89d-4fa1-b191-1a53ee28e769 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:50.944482 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-79613ca2-f89d-4fa1-b191-1a53ee28e769 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:50.944933 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-79613ca2-f89d-4fa1-b191-1a53ee28e769 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:50.945695 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-79613ca2-f89d-4fa1-b191-1a53ee28e769 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:50.946132 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-79613ca2-f89d-4fa1-b191-1a53ee28e769 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:51.076687 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-79613ca2-f89d-4fa1-b191-1a53ee28e769 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:51.083951 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-79613ca2-f89d-4fa1-b191-1a53ee28e769 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1366 microversion: 2.1 time: 0.150269 May 09 04:29:51.084512 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 262/535] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:50 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:51.772147 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-2786a4cf-8a22-47fc-972a-60eda077e436 req-087f8061-06b2-480f-af48-517311e8b81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42b820f-fd46-4c3a-bbef-65871250c13d", "name": "network-vif-plugged", "status": "completed", "tag": "e9b357da-dcf1-479a-8514-427749cafd62"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:51.781468 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-2786a4cf-8a22-47fc-972a-60eda077e436 req-087f8061-06b2-480f-af48-517311e8b81b service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:51.781918 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-2786a4cf-8a22-47fc-972a-60eda077e436 req-087f8061-06b2-480f-af48-517311e8b81b service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:51.794307 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-2786a4cf-8a22-47fc-972a-60eda077e436 req-087f8061-06b2-480f-af48-517311e8b81b service nova] Creating event network-vif-plugged:e9b357da-dcf1-479a-8514-427749cafd62 for instance c42b820f-fd46-4c3a-bbef-65871250c13d on hv-cinder-83800 May 09 04:29:51.799382 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-2786a4cf-8a22-47fc-972a-60eda077e436 req-087f8061-06b2-480f-af48-517311e8b81b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030991 May 09 04:29:51.800100 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 274/536] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:52.101189 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1319d28a-da57-4b43-b485-470cad90b538 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:52.101798 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1319d28a-da57-4b43-b485-470cad90b538 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:52.108448 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1319d28a-da57-4b43-b485-470cad90b538 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:52.108895 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1319d28a-da57-4b43-b485-470cad90b538 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:52.109652 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1319d28a-da57-4b43-b485-470cad90b538 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:52.110083 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1319d28a-da57-4b43-b485-470cad90b538 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:52.241093 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1319d28a-da57-4b43-b485-470cad90b538 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:52.248396 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1319d28a-da57-4b43-b485-470cad90b538 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1366 microversion: 2.1 time: 0.151147 May 09 04:29:52.248961 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 263/537] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:52 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:52.937771 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 04:29:52.938372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Mon May 9 04:29:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 04:29:53.266050 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-bc326094-aa78-4646-a346-dbfd485965cb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:53.266742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-bc326094-aa78-4646-a346-dbfd485965cb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:53.272942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bc326094-aa78-4646-a346-dbfd485965cb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:53.273389 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bc326094-aa78-4646-a346-dbfd485965cb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:53.274173 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bc326094-aa78-4646-a346-dbfd485965cb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:53.274601 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bc326094-aa78-4646-a346-dbfd485965cb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:53.400097 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-bc326094-aa78-4646-a346-dbfd485965cb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:53.407789 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-bc326094-aa78-4646-a346-dbfd485965cb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1366 microversion: 2.1 time: 0.146358 May 09 04:29:53.408363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 275/538] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:53 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:54.425306 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a8f2dc4a-91fc-4f16-b69f-aa8bf53ec0df tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:54.425848 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a8f2dc4a-91fc-4f16-b69f-aa8bf53ec0df tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:54.432973 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a8f2dc4a-91fc-4f16-b69f-aa8bf53ec0df tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:54.433422 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a8f2dc4a-91fc-4f16-b69f-aa8bf53ec0df tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:54.434188 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a8f2dc4a-91fc-4f16-b69f-aa8bf53ec0df tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:54.434621 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a8f2dc4a-91fc-4f16-b69f-aa8bf53ec0df tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:54.562966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a8f2dc4a-91fc-4f16-b69f-aa8bf53ec0df tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:54.570217 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a8f2dc4a-91fc-4f16-b69f-aa8bf53ec0df tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1366 microversion: 2.1 time: 0.148877 May 09 04:29:54.570788 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 264/539] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:54 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:29:55.586634 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8c1c37b3-811f-416d-821f-b3d62e45f080 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:55.587430 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8c1c37b3-811f-416d-821f-b3d62e45f080 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:55.594778 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8c1c37b3-811f-416d-821f-b3d62e45f080 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:55.595222 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8c1c37b3-811f-416d-821f-b3d62e45f080 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:55.596009 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8c1c37b3-811f-416d-821f-b3d62e45f080 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:55.596440 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8c1c37b3-811f-416d-821f-b3d62e45f080 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:55.722982 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8c1c37b3-811f-416d-821f-b3d62e45f080 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:55.730826 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8c1c37b3-811f-416d-821f-b3d62e45f080 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1366 microversion: 2.1 time: 0.148196 May 09 04:29:55.731394 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 276/540] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:55 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:56.747362 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1d8b3517-6b6d-43be-a05f-8330a57d299c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:56.748003 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1d8b3517-6b6d-43be-a05f-8330a57d299c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:56.754239 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1d8b3517-6b6d-43be-a05f-8330a57d299c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:56.754696 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1d8b3517-6b6d-43be-a05f-8330a57d299c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:56.755468 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1d8b3517-6b6d-43be-a05f-8330a57d299c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:56.756024 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1d8b3517-6b6d-43be-a05f-8330a57d299c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:56.887306 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1d8b3517-6b6d-43be-a05f-8330a57d299c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:56.894590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1d8b3517-6b6d-43be-a05f-8330a57d299c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1366 microversion: 2.1 time: 0.151915 May 09 04:29:56.895167 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 265/541] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:56 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:57.911984 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-21cdc529-4248-4763-a830-837c073b5c92 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:57.912619 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-21cdc529-4248-4763-a830-837c073b5c92 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:57.919177 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-21cdc529-4248-4763-a830-837c073b5c92 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:57.919618 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-21cdc529-4248-4763-a830-837c073b5c92 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:57.920407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-21cdc529-4248-4763-a830-837c073b5c92 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:57.920842 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-21cdc529-4248-4763-a830-837c073b5c92 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:58.050040 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-21cdc529-4248-4763-a830-837c073b5c92 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:29:58.057796 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-21cdc529-4248-4763-a830-837c073b5c92 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1555 microversion: 2.1 time: 0.149790 May 09 04:29:58.058353 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 277/542] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:29:57 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:29:58.074250 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e7a21bd3-e3d6-4e94-82fb-63713cd328a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:58.074739 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e7a21bd3-e3d6-4e94-82fb-63713cd328a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:58.081037 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e7a21bd3-e3d6-4e94-82fb-63713cd328a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:58.081476 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e7a21bd3-e3d6-4e94-82fb-63713cd328a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:58.082226 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e7a21bd3-e3d6-4e94-82fb-63713cd328a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:58.082649 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e7a21bd3-e3d6-4e94-82fb-63713cd328a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:58.161174 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e7a21bd3-e3d6-4e94-82fb-63713cd328a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091310 May 09 04:29:58.161783 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 266/543] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 04:29:58 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:59.339589 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-13c7cbf6-3387-40ab-98b9-ea70b3b24d43 req-ac40f12c-e5a1-482d-8c9e-11980d27cba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42b820f-fd46-4c3a-bbef-65871250c13d", "tag": "e9b357da-dcf1-479a-8514-427749cafd62"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:29:59.348180 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-13c7cbf6-3387-40ab-98b9-ea70b3b24d43 req-ac40f12c-e5a1-482d-8c9e-11980d27cba4 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:59.348621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-13c7cbf6-3387-40ab-98b9-ea70b3b24d43 req-ac40f12c-e5a1-482d-8c9e-11980d27cba4 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:59.360251 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-13c7cbf6-3387-40ab-98b9-ea70b3b24d43 req-ac40f12c-e5a1-482d-8c9e-11980d27cba4 service nova] Creating event network-changed:e9b357da-dcf1-479a-8514-427749cafd62 for instance c42b820f-fd46-4c3a-bbef-65871250c13d on hv-cinder-83800 May 09 04:29:59.365285 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-13c7cbf6-3387-40ab-98b9-ea70b3b24d43 req-ac40f12c-e5a1-482d-8c9e-11980d27cba4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030391 May 09 04:29:59.365868 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 278/544] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:29:59.501421 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-22c22f69-9a9f-4a39-b4bd-16cb903294bd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:29:59.502062 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-22c22f69-9a9f-4a39-b4bd-16cb903294bd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:29:59.508686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-22c22f69-9a9f-4a39-b4bd-16cb903294bd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:59.509203 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-22c22f69-9a9f-4a39-b4bd-16cb903294bd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:59.510134 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-22c22f69-9a9f-4a39-b4bd-16cb903294bd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:29:59.510739 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-22c22f69-9a9f-4a39-b4bd-16cb903294bd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:29:59.639825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-22c22f69-9a9f-4a39-b4bd-16cb903294bd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lazy-loading 'services' on Instance uuid f2923fc2-3ae0-4f89-b36c-193752581504 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:29:59.758154 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-22c22f69-9a9f-4a39-b4bd-16cb903294bd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/os-volume_attachments/257f75e5-ec01-473d-a2dd-b1ade5036461" status: 202 len: 0 microversion: 2.1 time: 0.258062 May 09 04:29:59.769632 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 267/545] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 04:29:59 2022] DELETE /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/os-volume_attachments/257f75e5-ec01-473d-a2dd-b1ade5036461 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:30:01.944228 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-cbe90a71-3c0a-4d0a-b04e-ea07a8e835db tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:01.950618 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cbe90a71-3c0a-4d0a-b04e-ea07a8e835db tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:01.951071 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cbe90a71-3c0a-4d0a-b04e-ea07a8e835db tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:01.977504 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-cbe90a71-3c0a-4d0a-b04e-ea07a8e835db tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Going to try to stop instance {{(pid=117033) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 09 04:30:02.025120 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-cbe90a71-3c0a-4d0a-b04e-ea07a8e835db tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "POST /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/action" status: 202 len: 0 microversion: 2.1 time: 0.085170 May 09 04:30:02.026072 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 279/546] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 04:30:01 2022] POST /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:30:02.036021 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7dba64fd-c78e-42e7-8190-84f982cb88b4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:02.036728 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7dba64fd-c78e-42e7-8190-84f982cb88b4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:02.045774 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7dba64fd-c78e-42e7-8190-84f982cb88b4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:02.046274 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7dba64fd-c78e-42e7-8190-84f982cb88b4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:02.047487 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7dba64fd-c78e-42e7-8190-84f982cb88b4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:02.047940 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7dba64fd-c78e-42e7-8190-84f982cb88b4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:02.192690 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7dba64fd-c78e-42e7-8190-84f982cb88b4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:02.201601 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7dba64fd-c78e-42e7-8190-84f982cb88b4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1678 microversion: 2.1 time: 0.170786 May 09 04:30:02.202185 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 268/547] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:02 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:03.221464 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4634d5d4-84c8-4289-972d-51a93811029e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:03.222195 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-4634d5d4-84c8-4289-972d-51a93811029e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:03.229050 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4634d5d4-84c8-4289-972d-51a93811029e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:03.229499 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4634d5d4-84c8-4289-972d-51a93811029e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:03.230255 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4634d5d4-84c8-4289-972d-51a93811029e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:03.230687 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4634d5d4-84c8-4289-972d-51a93811029e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:03.360576 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4634d5d4-84c8-4289-972d-51a93811029e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:03.367801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-4634d5d4-84c8-4289-972d-51a93811029e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1678 microversion: 2.1 time: 0.150510 May 09 04:30:03.368395 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 280/548] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:03 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:04.385300 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1986a7bb-345f-4e99-8f11-2b895ae37134 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:04.385928 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1986a7bb-345f-4e99-8f11-2b895ae37134 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:04.392412 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1986a7bb-345f-4e99-8f11-2b895ae37134 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:04.392860 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1986a7bb-345f-4e99-8f11-2b895ae37134 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:04.393616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1986a7bb-345f-4e99-8f11-2b895ae37134 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:04.394083 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1986a7bb-345f-4e99-8f11-2b895ae37134 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:04.518010 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1986a7bb-345f-4e99-8f11-2b895ae37134 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:04.526340 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1986a7bb-345f-4e99-8f11-2b895ae37134 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1678 microversion: 2.1 time: 0.143988 May 09 04:30:04.526927 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 269/549] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:04 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:05.543982 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-428f5c8c-904f-4938-b850-d14ab3bf3d56 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:05.544537 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-428f5c8c-904f-4938-b850-d14ab3bf3d56 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:05.550524 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-428f5c8c-904f-4938-b850-d14ab3bf3d56 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:05.550967 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-428f5c8c-904f-4938-b850-d14ab3bf3d56 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:05.551720 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-428f5c8c-904f-4938-b850-d14ab3bf3d56 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:05.552190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-428f5c8c-904f-4938-b850-d14ab3bf3d56 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:05.678878 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-428f5c8c-904f-4938-b850-d14ab3bf3d56 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:05.686244 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-428f5c8c-904f-4938-b850-d14ab3bf3d56 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1678 microversion: 2.1 time: 0.147184 May 09 04:30:05.686803 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 281/550] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:05 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:06.703242 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-892d0a1a-8cf0-431e-b3aa-6480b8918a69 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:06.703765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-892d0a1a-8cf0-431e-b3aa-6480b8918a69 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:06.710131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-892d0a1a-8cf0-431e-b3aa-6480b8918a69 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:06.710573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-892d0a1a-8cf0-431e-b3aa-6480b8918a69 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:06.711320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-892d0a1a-8cf0-431e-b3aa-6480b8918a69 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:06.711750 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-892d0a1a-8cf0-431e-b3aa-6480b8918a69 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:06.842253 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-892d0a1a-8cf0-431e-b3aa-6480b8918a69 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:06.849550 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-892d0a1a-8cf0-431e-b3aa-6480b8918a69 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1678 microversion: 2.1 time: 0.150270 May 09 04:30:06.850114 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 270/551] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:06 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:07.866448 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b6e21058-9d8c-4857-9b56-25687b2f41b1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:07.867050 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b6e21058-9d8c-4857-9b56-25687b2f41b1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:07.874069 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b6e21058-9d8c-4857-9b56-25687b2f41b1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:07.874521 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b6e21058-9d8c-4857-9b56-25687b2f41b1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:07.875262 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b6e21058-9d8c-4857-9b56-25687b2f41b1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:07.875692 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b6e21058-9d8c-4857-9b56-25687b2f41b1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:08.000832 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b6e21058-9d8c-4857-9b56-25687b2f41b1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:08.008089 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b6e21058-9d8c-4857-9b56-25687b2f41b1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1678 microversion: 2.1 time: 0.145404 May 09 04:30:08.008653 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 282/552] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:07 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:09.025457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4ce6dd08-e033-40a1-bc2e-ea6b4d5112b2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:09.026067 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4ce6dd08-e033-40a1-bc2e-ea6b4d5112b2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:09.032483 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4ce6dd08-e033-40a1-bc2e-ea6b4d5112b2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:09.032924 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4ce6dd08-e033-40a1-bc2e-ea6b4d5112b2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:09.033680 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4ce6dd08-e033-40a1-bc2e-ea6b4d5112b2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:09.034110 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4ce6dd08-e033-40a1-bc2e-ea6b4d5112b2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:09.162452 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4ce6dd08-e033-40a1-bc2e-ea6b4d5112b2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:09.169887 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4ce6dd08-e033-40a1-bc2e-ea6b4d5112b2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1678 microversion: 2.1 time: 0.148491 May 09 04:30:09.170451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 271/553] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:09 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:10.186725 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ddd1781b-d07a-4118-b569-a08f55b4ef46 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:10.187361 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ddd1781b-d07a-4118-b569-a08f55b4ef46 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:10.193753 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ddd1781b-d07a-4118-b569-a08f55b4ef46 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:10.194206 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ddd1781b-d07a-4118-b569-a08f55b4ef46 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:10.194969 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ddd1781b-d07a-4118-b569-a08f55b4ef46 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:10.195404 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ddd1781b-d07a-4118-b569-a08f55b4ef46 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:10.329417 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ddd1781b-d07a-4118-b569-a08f55b4ef46 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:10.336933 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ddd1781b-d07a-4118-b569-a08f55b4ef46 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1678 microversion: 2.1 time: 0.154332 May 09 04:30:10.338957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 283/554] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:10 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:11.277666 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5d1e00c5-86cd-4d79-8212-6b9669bea61f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:11.278660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5d1e00c5-86cd-4d79-8212-6b9669bea61f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:11.285340 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d1e00c5-86cd-4d79-8212-6b9669bea61f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:11.285778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d1e00c5-86cd-4d79-8212-6b9669bea61f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:11.286538 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d1e00c5-86cd-4d79-8212-6b9669bea61f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:11.286963 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d1e00c5-86cd-4d79-8212-6b9669bea61f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:11.355693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ee55c8f0-48e0-4a90-ad52-f531af143272 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:11.356355 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ee55c8f0-48e0-4a90-ad52-f531af143272 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:11.363193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ee55c8f0-48e0-4a90-ad52-f531af143272 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:11.363642 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ee55c8f0-48e0-4a90-ad52-f531af143272 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:11.364442 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ee55c8f0-48e0-4a90-ad52-f531af143272 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:11.364881 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ee55c8f0-48e0-4a90-ad52-f531af143272 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:11.367589 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5d1e00c5-86cd-4d79-8212-6b9669bea61f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "POST /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/action" status: 202 len: 0 microversion: 2.1 time: 0.094675 May 09 04:30:11.369814 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 272/555] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 04:30:11 2022] POST /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:30:11.377098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-39b74daf-5bae-4559-985c-ddd47bc47f90 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:11.377791 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-39b74daf-5bae-4559-985c-ddd47bc47f90 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:11.384128 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-39b74daf-5bae-4559-985c-ddd47bc47f90 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:11.384625 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-39b74daf-5bae-4559-985c-ddd47bc47f90 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:11.385392 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-39b74daf-5bae-4559-985c-ddd47bc47f90 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:11.385821 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-39b74daf-5bae-4559-985c-ddd47bc47f90 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:11.503436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ee55c8f0-48e0-4a90-ad52-f531af143272 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:11.511311 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ee55c8f0-48e0-4a90-ad52-f531af143272 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1678 microversion: 2.1 time: 0.160129 May 09 04:30:11.511886 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 284/556] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:11 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:11.614496 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-39b74daf-5bae-4559-985c-ddd47bc47f90 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:11.622346 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-39b74daf-5bae-4559-985c-ddd47bc47f90 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1751 microversion: 2.1 time: 0.249335 May 09 04:30:11.622928 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 273/557] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:11 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1751 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:12.528535 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b910ed23-fc17-4d29-b56e-4688fc70b55b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:12.529151 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b910ed23-fc17-4d29-b56e-4688fc70b55b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:12.535602 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b910ed23-fc17-4d29-b56e-4688fc70b55b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:12.536111 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b910ed23-fc17-4d29-b56e-4688fc70b55b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:12.536879 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b910ed23-fc17-4d29-b56e-4688fc70b55b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:12.537319 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b910ed23-fc17-4d29-b56e-4688fc70b55b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:12.639684 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-10c3b19e-f577-4813-94cf-e41f6e97d6a9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:12.640373 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-10c3b19e-f577-4813-94cf-e41f6e97d6a9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:12.646751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10c3b19e-f577-4813-94cf-e41f6e97d6a9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:12.647190 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10c3b19e-f577-4813-94cf-e41f6e97d6a9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:12.647964 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10c3b19e-f577-4813-94cf-e41f6e97d6a9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:12.648390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10c3b19e-f577-4813-94cf-e41f6e97d6a9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:12.663668 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b910ed23-fc17-4d29-b56e-4688fc70b55b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:12.671515 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b910ed23-fc17-4d29-b56e-4688fc70b55b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1678 microversion: 2.1 time: 0.147242 May 09 04:30:12.672099 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 285/558] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:12 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:12.788215 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-10c3b19e-f577-4813-94cf-e41f6e97d6a9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:12.796819 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-10c3b19e-f577-4813-94cf-e41f6e97d6a9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1756 microversion: 2.1 time: 0.160968 May 09 04:30:12.797388 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 274/559] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:12 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:13.688608 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-aac73de9-aeb4-4b84-a502-9d1c169a88b6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:13.689157 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-aac73de9-aeb4-4b84-a502-9d1c169a88b6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:13.695609 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aac73de9-aeb4-4b84-a502-9d1c169a88b6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:13.696103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aac73de9-aeb4-4b84-a502-9d1c169a88b6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:13.696887 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aac73de9-aeb4-4b84-a502-9d1c169a88b6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:13.697556 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aac73de9-aeb4-4b84-a502-9d1c169a88b6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:13.814070 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e33a2650-b831-4263-b82e-57372c5f0411 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:13.814681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e33a2650-b831-4263-b82e-57372c5f0411 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:13.821123 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e33a2650-b831-4263-b82e-57372c5f0411 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:13.821573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e33a2650-b831-4263-b82e-57372c5f0411 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:13.822849 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e33a2650-b831-4263-b82e-57372c5f0411 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:13.823290 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e33a2650-b831-4263-b82e-57372c5f0411 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:13.829641 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-aac73de9-aeb4-4b84-a502-9d1c169a88b6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:13.837116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-aac73de9-aeb4-4b84-a502-9d1c169a88b6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1678 microversion: 2.1 time: 0.152451 May 09 04:30:13.838586 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 286/560] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:13 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:13.964525 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e33a2650-b831-4263-b82e-57372c5f0411 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:13.972392 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e33a2650-b831-4263-b82e-57372c5f0411 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1756 microversion: 2.1 time: 0.162143 May 09 04:30:13.972960 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 275/561] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:13 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:14.854829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f42d12d7-78e7-43ca-b951-6c6e282029a9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:14.855427 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f42d12d7-78e7-43ca-b951-6c6e282029a9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:14.861881 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f42d12d7-78e7-43ca-b951-6c6e282029a9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:14.862325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f42d12d7-78e7-43ca-b951-6c6e282029a9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:14.863105 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f42d12d7-78e7-43ca-b951-6c6e282029a9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:14.863531 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f42d12d7-78e7-43ca-b951-6c6e282029a9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:14.989588 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d6c459e9-c1b7-429d-bf43-5a19672c04a4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:14.990094 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f42d12d7-78e7-43ca-b951-6c6e282029a9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:14.990227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d6c459e9-c1b7-429d-bf43-5a19672c04a4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:14.997059 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d6c459e9-c1b7-429d-bf43-5a19672c04a4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:14.997503 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d6c459e9-c1b7-429d-bf43-5a19672c04a4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:14.997922 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f42d12d7-78e7-43ca-b951-6c6e282029a9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1678 microversion: 2.1 time: 0.146978 May 09 04:30:14.998267 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d6c459e9-c1b7-429d-bf43-5a19672c04a4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:14.998694 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 287/562] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:14 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:14.998808 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d6c459e9-c1b7-429d-bf43-5a19672c04a4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:15.140394 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d6c459e9-c1b7-429d-bf43-5a19672c04a4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:15.148125 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d6c459e9-c1b7-429d-bf43-5a19672c04a4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1756 microversion: 2.1 time: 0.162356 May 09 04:30:15.148690 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 276/563] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:14 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:16.015439 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e2a29bbc-9330-46be-8f72-44ee46dbfddc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:16.016008 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e2a29bbc-9330-46be-8f72-44ee46dbfddc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:16.022937 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e2a29bbc-9330-46be-8f72-44ee46dbfddc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:16.023591 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e2a29bbc-9330-46be-8f72-44ee46dbfddc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:16.024701 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e2a29bbc-9330-46be-8f72-44ee46dbfddc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:16.025664 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e2a29bbc-9330-46be-8f72-44ee46dbfddc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:16.155634 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e2a29bbc-9330-46be-8f72-44ee46dbfddc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:16.163126 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e2a29bbc-9330-46be-8f72-44ee46dbfddc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1678 microversion: 2.1 time: 0.151580 May 09 04:30:16.163695 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 288/564] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:16 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:16.164804 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-192b0434-756b-4e73-a63e-74c658459349 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:16.165409 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-192b0434-756b-4e73-a63e-74c658459349 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:16.171824 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-192b0434-756b-4e73-a63e-74c658459349 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:16.172296 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-192b0434-756b-4e73-a63e-74c658459349 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:16.173049 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-192b0434-756b-4e73-a63e-74c658459349 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:16.173474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-192b0434-756b-4e73-a63e-74c658459349 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:16.312044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-192b0434-756b-4e73-a63e-74c658459349 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:16.319875 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-192b0434-756b-4e73-a63e-74c658459349 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1756 microversion: 2.1 time: 0.158815 May 09 04:30:16.320474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 277/565] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:16 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:17.180481 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-84923e43-4e54-4d73-b294-9081ff929ada tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:17.181028 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-84923e43-4e54-4d73-b294-9081ff929ada tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:17.187993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-84923e43-4e54-4d73-b294-9081ff929ada tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:17.188441 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-84923e43-4e54-4d73-b294-9081ff929ada tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:17.189200 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-84923e43-4e54-4d73-b294-9081ff929ada tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:17.189630 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-84923e43-4e54-4d73-b294-9081ff929ada tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:17.318879 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-84923e43-4e54-4d73-b294-9081ff929ada tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:17.326299 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-84923e43-4e54-4d73-b294-9081ff929ada tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1678 microversion: 2.1 time: 0.149703 May 09 04:30:17.326866 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 289/566] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:17 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:17.337154 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-356b9c74-280b-45b7-8553-272dca1f4b6f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:17.338734 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-356b9c74-280b-45b7-8553-272dca1f4b6f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:17.345031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-356b9c74-280b-45b7-8553-272dca1f4b6f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:17.345473 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-356b9c74-280b-45b7-8553-272dca1f4b6f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:17.346225 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-356b9c74-280b-45b7-8553-272dca1f4b6f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:17.346655 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-356b9c74-280b-45b7-8553-272dca1f4b6f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:17.489029 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-356b9c74-280b-45b7-8553-272dca1f4b6f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:17.496981 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-356b9c74-280b-45b7-8553-272dca1f4b6f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1756 microversion: 2.1 time: 0.163620 May 09 04:30:17.497551 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 278/567] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:17 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:18.343186 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6ecc2317-495e-4902-b102-88ebc8a3681b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:18.343799 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6ecc2317-495e-4902-b102-88ebc8a3681b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:18.350150 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6ecc2317-495e-4902-b102-88ebc8a3681b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:18.350603 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6ecc2317-495e-4902-b102-88ebc8a3681b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:18.351367 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6ecc2317-495e-4902-b102-88ebc8a3681b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:18.351806 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6ecc2317-495e-4902-b102-88ebc8a3681b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:18.476483 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-6ecc2317-495e-4902-b102-88ebc8a3681b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:18.484540 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6ecc2317-495e-4902-b102-88ebc8a3681b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1655 microversion: 2.1 time: 0.145215 May 09 04:30:18.485103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 290/568] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:18 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1655 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:18.501280 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e988ff70-8dbd-456e-9f97-67d035fd8d7c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:18.507682 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e988ff70-8dbd-456e-9f97-67d035fd8d7c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:18.508168 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e988ff70-8dbd-456e-9f97-67d035fd8d7c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:18.514644 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ba6337ba-f71f-414b-b891-035210d64fd9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c1ee093-b80f-411a-80bf-f4217df3af70"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:18.515703 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ba6337ba-f71f-414b-b891-035210d64fd9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:18.521541 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ba6337ba-f71f-414b-b891-035210d64fd9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:18.521993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ba6337ba-f71f-414b-b891-035210d64fd9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:18.522755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ba6337ba-f71f-414b-b891-035210d64fd9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:18.523192 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ba6337ba-f71f-414b-b891-035210d64fd9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:18.530467 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e988ff70-8dbd-456e-9f97-67d035fd8d7c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Going to try to start instance {{(pid=117032) start /opt/stack/nova/nova/compute/api.py:2730}} May 09 04:30:18.574195 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e988ff70-8dbd-456e-9f97-67d035fd8d7c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "POST /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/action" status: 202 len: 0 microversion: 2.1 time: 0.076572 May 09 04:30:18.574796 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 279/569] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 04:30:18 2022] POST /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:30:18.580126 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5bcb6b60-9bb0-4f81-acdc-a75fe4ce6e2d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:18.580729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5bcb6b60-9bb0-4f81-acdc-a75fe4ce6e2d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:18.586972 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5bcb6b60-9bb0-4f81-acdc-a75fe4ce6e2d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:18.587956 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5bcb6b60-9bb0-4f81-acdc-a75fe4ce6e2d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:18.588500 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5bcb6b60-9bb0-4f81-acdc-a75fe4ce6e2d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:18.588966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5bcb6b60-9bb0-4f81-acdc-a75fe4ce6e2d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:18.776424 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ba6337ba-f71f-414b-b891-035210d64fd9 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "POST /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265489 May 09 04:30:18.777038 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 291/570] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 04:30:18 2022] POST /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:30:18.786248 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1bca6c10-569d-4ffe-844d-c6b59ec8e47e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:18.786984 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1bca6c10-569d-4ffe-844d-c6b59ec8e47e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:18.794713 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1bca6c10-569d-4ffe-844d-c6b59ec8e47e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:18.795161 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1bca6c10-569d-4ffe-844d-c6b59ec8e47e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:18.795971 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1bca6c10-569d-4ffe-844d-c6b59ec8e47e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:18.796416 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1bca6c10-569d-4ffe-844d-c6b59ec8e47e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:18.979646 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1bca6c10-569d-4ffe-844d-c6b59ec8e47e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:18.987601 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1bca6c10-569d-4ffe-844d-c6b59ec8e47e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1664 microversion: 2.1 time: 0.209271 May 09 04:30:18.988439 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 292/571] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:18 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1664 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:19.098709 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5bcb6b60-9bb0-4f81-acdc-a75fe4ce6e2d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:19.107361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5bcb6b60-9bb0-4f81-acdc-a75fe4ce6e2d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1756 microversion: 2.1 time: 0.531282 May 09 04:30:19.108240 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 280/572] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:18 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1756 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:20.005159 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-10083856-28d9-47bd-91b1-46b83fd00d76 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:20.005801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-10083856-28d9-47bd-91b1-46b83fd00d76 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:20.012818 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-10083856-28d9-47bd-91b1-46b83fd00d76 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:20.013220 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-10083856-28d9-47bd-91b1-46b83fd00d76 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:20.013987 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-10083856-28d9-47bd-91b1-46b83fd00d76 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:20.014424 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-10083856-28d9-47bd-91b1-46b83fd00d76 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:20.124759 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b9fcb19b-0817-434a-b236-7cf6b4a04f33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:20.125370 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b9fcb19b-0817-434a-b236-7cf6b4a04f33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:20.131737 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b9fcb19b-0817-434a-b236-7cf6b4a04f33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:20.132209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b9fcb19b-0817-434a-b236-7cf6b4a04f33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:20.132979 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b9fcb19b-0817-434a-b236-7cf6b4a04f33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:20.133409 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b9fcb19b-0817-434a-b236-7cf6b4a04f33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:20.143137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-10083856-28d9-47bd-91b1-46b83fd00d76 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:20.151343 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-10083856-28d9-47bd-91b1-46b83fd00d76 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1664 microversion: 2.1 time: 0.150051 May 09 04:30:20.152116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 293/573] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:20 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:20.276300 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b9fcb19b-0817-434a-b236-7cf6b4a04f33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:20.284175 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b9fcb19b-0817-434a-b236-7cf6b4a04f33 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1756 microversion: 2.1 time: 0.163163 May 09 04:30:20.284755 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 281/574] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:20 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:21.169233 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f5d0fdfc-2431-4605-b431-f819d3e0e19b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:21.169784 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f5d0fdfc-2431-4605-b431-f819d3e0e19b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:21.176107 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f5d0fdfc-2431-4605-b431-f819d3e0e19b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:21.176588 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f5d0fdfc-2431-4605-b431-f819d3e0e19b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:21.177356 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f5d0fdfc-2431-4605-b431-f819d3e0e19b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:21.177793 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f5d0fdfc-2431-4605-b431-f819d3e0e19b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:21.302556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f67746d4-3f17-4ec2-bade-691713967269 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:21.303165 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f67746d4-3f17-4ec2-bade-691713967269 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:21.306630 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f5d0fdfc-2431-4605-b431-f819d3e0e19b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:21.310182 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f67746d4-3f17-4ec2-bade-691713967269 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:21.310625 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f67746d4-3f17-4ec2-bade-691713967269 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:21.311390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f67746d4-3f17-4ec2-bade-691713967269 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:21.311818 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f67746d4-3f17-4ec2-bade-691713967269 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:21.314247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f5d0fdfc-2431-4605-b431-f819d3e0e19b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1668 microversion: 2.1 time: 0.149723 May 09 04:30:21.314812 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 294/575] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:21 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:21.456090 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f67746d4-3f17-4ec2-bade-691713967269 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:21.464870 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f67746d4-3f17-4ec2-bade-691713967269 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1756 microversion: 2.1 time: 0.166209 May 09 04:30:21.465434 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 282/576] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:21 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:22.482341 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e931fc45-65c8-4970-8470-05c528bf8b1d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:22.482955 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e931fc45-65c8-4970-8470-05c528bf8b1d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:22.489414 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e931fc45-65c8-4970-8470-05c528bf8b1d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:22.489867 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e931fc45-65c8-4970-8470-05c528bf8b1d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:22.490629 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e931fc45-65c8-4970-8470-05c528bf8b1d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:22.491100 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e931fc45-65c8-4970-8470-05c528bf8b1d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:22.630501 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e931fc45-65c8-4970-8470-05c528bf8b1d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:22.638931 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e931fc45-65c8-4970-8470-05c528bf8b1d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1756 microversion: 2.1 time: 0.161180 May 09 04:30:22.639500 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 295/577] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:22 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:23.656448 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1177e69f-fcf2-4c54-9490-a0bd7328ef8c tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:23.657086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1177e69f-fcf2-4c54-9490-a0bd7328ef8c tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:23.664008 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1177e69f-fcf2-4c54-9490-a0bd7328ef8c tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:23.664455 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1177e69f-fcf2-4c54-9490-a0bd7328ef8c tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:23.665217 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1177e69f-fcf2-4c54-9490-a0bd7328ef8c tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:23.665774 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1177e69f-fcf2-4c54-9490-a0bd7328ef8c tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:23.806678 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1177e69f-fcf2-4c54-9490-a0bd7328ef8c tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:23.814842 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1177e69f-fcf2-4c54-9490-a0bd7328ef8c tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1756 microversion: 2.1 time: 0.162301 May 09 04:30:23.815417 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 283/578] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:23 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:24.833712 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-69547342-b93a-474c-97a4-004ae65fcba6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:24.834362 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-69547342-b93a-474c-97a4-004ae65fcba6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:24.841386 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-69547342-b93a-474c-97a4-004ae65fcba6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:24.841841 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-69547342-b93a-474c-97a4-004ae65fcba6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:24.842610 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-69547342-b93a-474c-97a4-004ae65fcba6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:24.843047 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-69547342-b93a-474c-97a4-004ae65fcba6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:24.982752 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-69547342-b93a-474c-97a4-004ae65fcba6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:24.990919 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-69547342-b93a-474c-97a4-004ae65fcba6 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1756 microversion: 2.1 time: 0.161087 May 09 04:30:24.991490 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 296/579] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:24 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:26.007679 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ffb583c1-4555-4d38-a043-a26fb2bac32d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:26.008320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ffb583c1-4555-4d38-a043-a26fb2bac32d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:26.014557 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ffb583c1-4555-4d38-a043-a26fb2bac32d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:26.015007 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ffb583c1-4555-4d38-a043-a26fb2bac32d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:26.015763 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ffb583c1-4555-4d38-a043-a26fb2bac32d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:26.016219 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ffb583c1-4555-4d38-a043-a26fb2bac32d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:26.158640 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ffb583c1-4555-4d38-a043-a26fb2bac32d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:26.167460 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ffb583c1-4555-4d38-a043-a26fb2bac32d tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1756 microversion: 2.1 time: 0.163647 May 09 04:30:26.168059 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 284/580] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:26 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:26.272638 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a790c4ea-e2fa-4178-a10d-cab66de53a18 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:26.273595 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a790c4ea-e2fa-4178-a10d-cab66de53a18 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:26.280546 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a790c4ea-e2fa-4178-a10d-cab66de53a18 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:26.280994 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a790c4ea-e2fa-4178-a10d-cab66de53a18 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:26.281762 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a790c4ea-e2fa-4178-a10d-cab66de53a18 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:26.282199 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a790c4ea-e2fa-4178-a10d-cab66de53a18 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:26.305395 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.objects.instance [None req-a790c4ea-e2fa-4178-a10d-cab66de53a18 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lazy-loading 'flavor' on Instance uuid 4473a2d0-b3cc-401b-b460-7c00c66893a0 {{(pid=117033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:30:26.425730 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a790c4ea-e2fa-4178-a10d-cab66de53a18 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "POST /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/action" status: 200 len: 32 microversion: 2.1 time: 0.157052 May 09 04:30:26.426324 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 297/581] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 04:30:26 2022] POST /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 04:30:26.436013 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c6f51167-d7ce-43f5-959e-8d0b52eaacad tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:26.436624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c6f51167-d7ce-43f5-959e-8d0b52eaacad tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:26.442496 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6f51167-d7ce-43f5-959e-8d0b52eaacad tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:26.442944 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6f51167-d7ce-43f5-959e-8d0b52eaacad tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:26.443708 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6f51167-d7ce-43f5-959e-8d0b52eaacad tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:26.444174 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6f51167-d7ce-43f5-959e-8d0b52eaacad tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:26.575201 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c6f51167-d7ce-43f5-959e-8d0b52eaacad tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:26.582995 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c6f51167-d7ce-43f5-959e-8d0b52eaacad tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.150810 May 09 04:30:26.583565 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 285/582] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:26 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:27.185887 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e7baf3b1-729c-478e-bd32-717f6f74dc8e tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:27.186512 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e7baf3b1-729c-478e-bd32-717f6f74dc8e tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:27.192770 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e7baf3b1-729c-478e-bd32-717f6f74dc8e tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:27.193225 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e7baf3b1-729c-478e-bd32-717f6f74dc8e tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:27.193988 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e7baf3b1-729c-478e-bd32-717f6f74dc8e tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:27.194421 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e7baf3b1-729c-478e-bd32-717f6f74dc8e tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:27.340874 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e7baf3b1-729c-478e-bd32-717f6f74dc8e tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:27.348737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e7baf3b1-729c-478e-bd32-717f6f74dc8e tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1756 microversion: 2.1 time: 0.167315 May 09 04:30:27.349306 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 298/583] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:27 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:27.601008 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f0bce2ea-42c7-4d54-a459-186b6f44cded tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:27.601618 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f0bce2ea-42c7-4d54-a459-186b6f44cded tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:27.608219 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f0bce2ea-42c7-4d54-a459-186b6f44cded tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:27.608666 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f0bce2ea-42c7-4d54-a459-186b6f44cded tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:27.609425 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f0bce2ea-42c7-4d54-a459-186b6f44cded tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:27.609861 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f0bce2ea-42c7-4d54-a459-186b6f44cded tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:27.741099 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f0bce2ea-42c7-4d54-a459-186b6f44cded tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:27.749513 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f0bce2ea-42c7-4d54-a459-186b6f44cded tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.152355 May 09 04:30:27.750094 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 286/584] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:27 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:28.366227 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-40ce6114-11e3-400b-852b-f704990e5bbe tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:28.366854 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-40ce6114-11e3-400b-852b-f704990e5bbe tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:28.374510 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-40ce6114-11e3-400b-852b-f704990e5bbe tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:28.374967 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-40ce6114-11e3-400b-852b-f704990e5bbe tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:28.375735 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-40ce6114-11e3-400b-852b-f704990e5bbe tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:28.376388 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-40ce6114-11e3-400b-852b-f704990e5bbe tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:28.518882 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-40ce6114-11e3-400b-852b-f704990e5bbe tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:28.529863 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-40ce6114-11e3-400b-852b-f704990e5bbe tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1759 microversion: 2.1 time: 0.165679 May 09 04:30:28.530475 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 299/585] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:28 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:28.766564 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4a75259a-85d7-4aac-8a86-ea9d76d1835e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:28.767174 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4a75259a-85d7-4aac-8a86-ea9d76d1835e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:28.773613 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4a75259a-85d7-4aac-8a86-ea9d76d1835e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:28.774057 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4a75259a-85d7-4aac-8a86-ea9d76d1835e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:28.775004 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4a75259a-85d7-4aac-8a86-ea9d76d1835e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:28.775442 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4a75259a-85d7-4aac-8a86-ea9d76d1835e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:28.903869 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4a75259a-85d7-4aac-8a86-ea9d76d1835e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:28.911689 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4a75259a-85d7-4aac-8a86-ea9d76d1835e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.148958 May 09 04:30:28.912299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 287/586] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:28 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:29.929787 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-0ff0754a-45ea-427f-92cb-abd81d48a241 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:29.930435 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-0ff0754a-45ea-427f-92cb-abd81d48a241 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:29.937505 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0ff0754a-45ea-427f-92cb-abd81d48a241 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:29.937961 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0ff0754a-45ea-427f-92cb-abd81d48a241 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:29.938728 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0ff0754a-45ea-427f-92cb-abd81d48a241 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:29.939166 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0ff0754a-45ea-427f-92cb-abd81d48a241 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:30.067822 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-0ff0754a-45ea-427f-92cb-abd81d48a241 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:30.077705 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-0ff0754a-45ea-427f-92cb-abd81d48a241 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.151793 May 09 04:30:30.078275 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 300/587] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:29 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:31.095005 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f6ffb72e-0d5a-4236-9b94-b9e2062cbc5c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:31.095557 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f6ffb72e-0d5a-4236-9b94-b9e2062cbc5c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:31.101919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6ffb72e-0d5a-4236-9b94-b9e2062cbc5c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:31.102367 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6ffb72e-0d5a-4236-9b94-b9e2062cbc5c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:31.103126 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6ffb72e-0d5a-4236-9b94-b9e2062cbc5c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:31.103563 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6ffb72e-0d5a-4236-9b94-b9e2062cbc5c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:31.229642 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f6ffb72e-0d5a-4236-9b94-b9e2062cbc5c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:31.237432 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f6ffb72e-0d5a-4236-9b94-b9e2062cbc5c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.146414 May 09 04:30:31.238203 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 288/588] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:31 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:32.254714 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-642e048f-ecb9-4a88-bdeb-56adaaabbf29 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:32.255327 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-642e048f-ecb9-4a88-bdeb-56adaaabbf29 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:32.262469 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-642e048f-ecb9-4a88-bdeb-56adaaabbf29 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:32.262921 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-642e048f-ecb9-4a88-bdeb-56adaaabbf29 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:32.263689 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-642e048f-ecb9-4a88-bdeb-56adaaabbf29 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:32.264171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-642e048f-ecb9-4a88-bdeb-56adaaabbf29 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:32.393483 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-642e048f-ecb9-4a88-bdeb-56adaaabbf29 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:32.401600 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-642e048f-ecb9-4a88-bdeb-56adaaabbf29 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.150930 May 09 04:30:32.402168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 301/589] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:32 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:33.418708 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9134efa2-93cf-4c01-a405-162f490e2f6a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:33.419342 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9134efa2-93cf-4c01-a405-162f490e2f6a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:33.425752 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9134efa2-93cf-4c01-a405-162f490e2f6a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:33.426201 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9134efa2-93cf-4c01-a405-162f490e2f6a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:33.426980 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9134efa2-93cf-4c01-a405-162f490e2f6a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:33.427396 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9134efa2-93cf-4c01-a405-162f490e2f6a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:33.559980 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9134efa2-93cf-4c01-a405-162f490e2f6a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:33.567767 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9134efa2-93cf-4c01-a405-162f490e2f6a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.153148 May 09 04:30:33.568376 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 289/590] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:33 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:34.585623 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e6ec620f-a8a8-4a04-ba93-704ca12b68b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:34.586244 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e6ec620f-a8a8-4a04-ba93-704ca12b68b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:34.593536 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e6ec620f-a8a8-4a04-ba93-704ca12b68b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:34.593996 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e6ec620f-a8a8-4a04-ba93-704ca12b68b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:34.594763 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e6ec620f-a8a8-4a04-ba93-704ca12b68b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:34.595203 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e6ec620f-a8a8-4a04-ba93-704ca12b68b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:34.722991 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e6ec620f-a8a8-4a04-ba93-704ca12b68b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:34.732012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e6ec620f-a8a8-4a04-ba93-704ca12b68b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.150254 May 09 04:30:34.732587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 302/591] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:34 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:35.749701 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b5a536cb-d937-4b9b-a514-42a2cc2d4017 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:35.750304 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b5a536cb-d937-4b9b-a514-42a2cc2d4017 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:35.756716 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5a536cb-d937-4b9b-a514-42a2cc2d4017 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:35.757156 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5a536cb-d937-4b9b-a514-42a2cc2d4017 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:35.757913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5a536cb-d937-4b9b-a514-42a2cc2d4017 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:35.758343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5a536cb-d937-4b9b-a514-42a2cc2d4017 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:35.887777 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b5a536cb-d937-4b9b-a514-42a2cc2d4017 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:35.895702 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b5a536cb-d937-4b9b-a514-42a2cc2d4017 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.149819 May 09 04:30:35.896303 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 290/592] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:35 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:36.825030 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ef243896-994a-4a71-a7b0-53ea26cdc4b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:36.825587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ef243896-994a-4a71-a7b0-53ea26cdc4b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:36.831995 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ef243896-994a-4a71-a7b0-53ea26cdc4b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:36.832440 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ef243896-994a-4a71-a7b0-53ea26cdc4b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:36.833193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ef243896-994a-4a71-a7b0-53ea26cdc4b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:36.833623 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ef243896-994a-4a71-a7b0-53ea26cdc4b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:36.863821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ef243896-994a-4a71-a7b0-53ea26cdc4b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/os-volume_attachments/0456a173-bfb2-4569-b0a2-f1d6e41d70b1" status: 200 len: 194 microversion: 2.20 time: 0.043393 May 09 04:30:36.864413 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 303/593] 10.222.0.44 () {60 vars in 1453 bytes} [Mon May 9 04:30:36 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/os-volume_attachments/0456a173-bfb2-4569-b0a2-f1d6e41d70b1 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:30:36.912717 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2afef236-af0a-4417-a7be-0dfbed98c370 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:36.913328 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2afef236-af0a-4417-a7be-0dfbed98c370 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:36.920118 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2afef236-af0a-4417-a7be-0dfbed98c370 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:36.920537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2afef236-af0a-4417-a7be-0dfbed98c370 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:36.921303 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2afef236-af0a-4417-a7be-0dfbed98c370 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:36.921739 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2afef236-af0a-4417-a7be-0dfbed98c370 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:36.925554 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-187f66c3-031e-42f4-8fa7-8c4c27f384b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:36.926051 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-187f66c3-031e-42f4-8fa7-8c4c27f384b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:36.932850 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-187f66c3-031e-42f4-8fa7-8c4c27f384b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:36.933247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-187f66c3-031e-42f4-8fa7-8c4c27f384b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:36.934021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-187f66c3-031e-42f4-8fa7-8c4c27f384b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:36.934494 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-187f66c3-031e-42f4-8fa7-8c4c27f384b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:37.054342 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.objects.instance [None req-187f66c3-031e-42f4-8fa7-8c4c27f384b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lazy-loading 'services' on Instance uuid d10350c6-bf15-414f-9bf7-d371b6912be2 {{(pid=117033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:30:37.057965 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2afef236-af0a-4417-a7be-0dfbed98c370 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:37.064297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2afef236-af0a-4417-a7be-0dfbed98c370 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.155298 May 09 04:30:37.064874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 291/594] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:36 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:37.164029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-187f66c3-031e-42f4-8fa7-8c4c27f384b3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/os-volume_attachments/0456a173-bfb2-4569-b0a2-f1d6e41d70b1" status: 202 len: 0 microversion: 2.20 time: 0.242230 May 09 04:30:37.164615 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 304/595] 10.222.0.44 () {60 vars in 1456 bytes} [Mon May 9 04:30:36 2022] DELETE /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/os-volume_attachments/0456a173-bfb2-4569-b0a2-f1d6e41d70b1 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 04:30:37.173635 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8d83a988-4449-41d0-ba1f-b6e00ac1d7f2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:37.174607 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8d83a988-4449-41d0-ba1f-b6e00ac1d7f2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:37.180598 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8d83a988-4449-41d0-ba1f-b6e00ac1d7f2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:37.181822 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8d83a988-4449-41d0-ba1f-b6e00ac1d7f2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:37.182590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8d83a988-4449-41d0-ba1f-b6e00ac1d7f2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:37.183021 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8d83a988-4449-41d0-ba1f-b6e00ac1d7f2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:37.212241 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8d83a988-4449-41d0-ba1f-b6e00ac1d7f2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042515 May 09 04:30:37.213069 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 292/596] 10.222.0.44 () {60 vars in 1342 bytes} [Mon May 9 04:30:37 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 04:30:38.083093 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a347fab8-0f3d-4743-a193-e56bd8812d79 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:38.083707 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a347fab8-0f3d-4743-a193-e56bd8812d79 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:38.091057 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a347fab8-0f3d-4743-a193-e56bd8812d79 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:38.091506 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a347fab8-0f3d-4743-a193-e56bd8812d79 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:38.092314 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a347fab8-0f3d-4743-a193-e56bd8812d79 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:38.092754 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a347fab8-0f3d-4743-a193-e56bd8812d79 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:38.224098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4c16360c-d5b4-4d7e-9a25-a518b6d29323 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:38.225013 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4c16360c-d5b4-4d7e-9a25-a518b6d29323 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:38.231518 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c16360c-d5b4-4d7e-9a25-a518b6d29323 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:38.232002 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c16360c-d5b4-4d7e-9a25-a518b6d29323 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:38.232766 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c16360c-d5b4-4d7e-9a25-a518b6d29323 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:38.233198 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c16360c-d5b4-4d7e-9a25-a518b6d29323 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:38.235138 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a347fab8-0f3d-4743-a193-e56bd8812d79 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:38.243841 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a347fab8-0f3d-4743-a193-e56bd8812d79 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.164690 May 09 04:30:38.244445 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 305/597] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:38 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:38.262974 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4c16360c-d5b4-4d7e-9a25-a518b6d29323 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042807 May 09 04:30:38.263535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 293/598] 10.222.0.44 () {60 vars in 1342 bytes} [Mon May 9 04:30:38 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:38.322524 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-102e1b2b-55d9-4c9f-ba2f-3e13b5482f0b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:38.323015 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-102e1b2b-55d9-4c9f-ba2f-3e13b5482f0b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:38.329036 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-102e1b2b-55d9-4c9f-ba2f-3e13b5482f0b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:38.329488 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-102e1b2b-55d9-4c9f-ba2f-3e13b5482f0b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:38.330246 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-102e1b2b-55d9-4c9f-ba2f-3e13b5482f0b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:38.330684 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-102e1b2b-55d9-4c9f-ba2f-3e13b5482f0b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:38.355760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-102e1b2b-55d9-4c9f-ba2f-3e13b5482f0b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Going to try to terminate instance {{(pid=117033) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:30:38.430265 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-102e1b2b-55d9-4c9f-ba2f-3e13b5482f0b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 204 len: 0 microversion: 2.20 time: 0.111863 May 09 04:30:38.431874 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 306/599] 10.222.0.44 () {60 vars in 1279 bytes} [Mon May 9 04:30:38 2022] DELETE /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 04:30:38.440673 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-75291b90-6a05-41de-8175-804bef2e5e9e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:38.441272 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-75291b90-6a05-41de-8175-804bef2e5e9e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:38.448139 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75291b90-6a05-41de-8175-804bef2e5e9e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:38.448579 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75291b90-6a05-41de-8175-804bef2e5e9e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:38.449331 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75291b90-6a05-41de-8175-804bef2e5e9e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:38.449758 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75291b90-6a05-41de-8175-804bef2e5e9e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:38.582023 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-75291b90-6a05-41de-8175-804bef2e5e9e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:38.590054 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-75291b90-6a05-41de-8175-804bef2e5e9e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:38.591517 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-75291b90-6a05-41de-8175-804bef2e5e9e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:38.592690 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-75291b90-6a05-41de-8175-804bef2e5e9e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.156154 May 09 04:30:38.593247 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 294/600] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:38 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:30:39.261772 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b50c037d-ad71-4bce-a1a7-9b3eb9445dee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:39.262473 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b50c037d-ad71-4bce-a1a7-9b3eb9445dee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:39.268865 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b50c037d-ad71-4bce-a1a7-9b3eb9445dee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:39.269315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b50c037d-ad71-4bce-a1a7-9b3eb9445dee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:39.270075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b50c037d-ad71-4bce-a1a7-9b3eb9445dee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:39.270510 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b50c037d-ad71-4bce-a1a7-9b3eb9445dee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:39.398848 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b50c037d-ad71-4bce-a1a7-9b3eb9445dee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:39.407216 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b50c037d-ad71-4bce-a1a7-9b3eb9445dee tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.149665 May 09 04:30:39.407787 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 307/601] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:39 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:39.611656 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ea8b3c55-ca75-4df2-9f05-d531815505df tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:39.612214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ea8b3c55-ca75-4df2-9f05-d531815505df tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:39.618616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea8b3c55-ca75-4df2-9f05-d531815505df tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:39.619057 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea8b3c55-ca75-4df2-9f05-d531815505df tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:39.619815 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea8b3c55-ca75-4df2-9f05-d531815505df tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:39.620268 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea8b3c55-ca75-4df2-9f05-d531815505df tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:39.746545 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ea8b3c55-ca75-4df2-9f05-d531815505df tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:39.754574 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ea8b3c55-ca75-4df2-9f05-d531815505df tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:39.756108 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ea8b3c55-ca75-4df2-9f05-d531815505df tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:39.757267 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ea8b3c55-ca75-4df2-9f05-d531815505df tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.149580 May 09 04:30:39.757829 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 295/602] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:39 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:30:40.424674 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-aa014242-f70b-4070-851b-085b9b864051 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:40.425357 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-aa014242-f70b-4070-851b-085b9b864051 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:40.433061 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aa014242-f70b-4070-851b-085b9b864051 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:40.433453 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aa014242-f70b-4070-851b-085b9b864051 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:40.434220 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aa014242-f70b-4070-851b-085b9b864051 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:40.434655 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aa014242-f70b-4070-851b-085b9b864051 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:40.643332 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-aa014242-f70b-4070-851b-085b9b864051 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:40.651327 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-aa014242-f70b-4070-851b-085b9b864051 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.230516 May 09 04:30:40.652013 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 308/603] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:40 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:40.776463 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f82417af-c83b-42a8-a168-88213cbfabe5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:40.777070 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f82417af-c83b-42a8-a168-88213cbfabe5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:40.783381 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f82417af-c83b-42a8-a168-88213cbfabe5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:40.783820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f82417af-c83b-42a8-a168-88213cbfabe5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:40.784609 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f82417af-c83b-42a8-a168-88213cbfabe5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:40.785032 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f82417af-c83b-42a8-a168-88213cbfabe5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:40.918449 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f82417af-c83b-42a8-a168-88213cbfabe5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:40.926362 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f82417af-c83b-42a8-a168-88213cbfabe5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:40.927865 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f82417af-c83b-42a8-a168-88213cbfabe5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:40.929049 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f82417af-c83b-42a8-a168-88213cbfabe5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 200 len: 1723 microversion: 2.20 time: 0.157020 May 09 04:30:40.929611 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 296/604] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:40 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:30:41.318386 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-67ffef27-6d9f-40f6-9bbe-ca1cf9ae280b req-f380a1a7-0064-47a7-95fd-c32bf615b432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d10350c6-bf15-414f-9bf7-d371b6912be2", "name": "network-vif-deleted", "tag": "2abd51b8-3b37-4ec3-841e-462a68eb5cbc"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:41.326323 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-67ffef27-6d9f-40f6-9bbe-ca1cf9ae280b req-f380a1a7-0064-47a7-95fd-c32bf615b432 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:41.326775 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-67ffef27-6d9f-40f6-9bbe-ca1cf9ae280b req-f380a1a7-0064-47a7-95fd-c32bf615b432 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:41.339491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-67ffef27-6d9f-40f6-9bbe-ca1cf9ae280b req-f380a1a7-0064-47a7-95fd-c32bf615b432 service nova] Creating event network-vif-deleted:2abd51b8-3b37-4ec3-841e-462a68eb5cbc for instance d10350c6-bf15-414f-9bf7-d371b6912be2 on hv-cinder-83800 May 09 04:30:41.344272 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-67ffef27-6d9f-40f6-9bbe-ca1cf9ae280b req-f380a1a7-0064-47a7-95fd-c32bf615b432 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029619 May 09 04:30:41.344935 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 309/605] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:30:41.669711 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-97ebd560-9f44-4063-8ceb-9f3d6820043c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:41.670243 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-97ebd560-9f44-4063-8ceb-9f3d6820043c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:41.676306 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-97ebd560-9f44-4063-8ceb-9f3d6820043c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:41.676747 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-97ebd560-9f44-4063-8ceb-9f3d6820043c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:41.677504 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-97ebd560-9f44-4063-8ceb-9f3d6820043c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:41.677937 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-97ebd560-9f44-4063-8ceb-9f3d6820043c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:41.832679 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-97ebd560-9f44-4063-8ceb-9f3d6820043c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:41.846396 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-97ebd560-9f44-4063-8ceb-9f3d6820043c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.181260 May 09 04:30:41.860068 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 297/606] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:41 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:41.949901 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-96db007d-9175-47b5-8067-f8eee791c92a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:41.951592 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-96db007d-9175-47b5-8067-f8eee791c92a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:41.959533 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-96db007d-9175-47b5-8067-f8eee791c92a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:41.960346 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-96db007d-9175-47b5-8067-f8eee791c92a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:41.961481 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-96db007d-9175-47b5-8067-f8eee791c92a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:41.962502 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-96db007d-9175-47b5-8067-f8eee791c92a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:41.979233 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-96db007d-9175-47b5-8067-f8eee791c92a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] HTTP exception thrown: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-96db007d-9175-47b5-8067-f8eee791c92a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Request method failure captured: May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 HTTP/1.1 May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJfzsmXPUoXsG1RChTZ1zx5SCuZyA7ohBFF9v0tzYzP1MGXAVRwvMQWm-e9oFPHwtqP7h135tzc6wls5yWPFJ2rttUeZRGRKkLbNpAAkryfCMu9X44EiEvlGmFV1E1b_8HVW4P-QpkBHyII7LnJLGMqrkmk1LGFeSodef3EPfLFeUxE May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Openstack-Nova-Api-Version: 2.20 May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 5e56ba7f9cc64897a1d95ac15061e9e4 May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:30:41.981968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:30:41.983598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:30:41.983598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:30:41.983598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 5e56ba7f9cc64897a1d95ac15061e9e4 May 09 04:30:41.983598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:30:41.983598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-AttachVolumeShelveTestJSON-769609988-project May 09 04:30:41.983598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:30:41.983598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:30:41.983598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 4f8f6c77f898475e8acf1c4042c3928b May 09 04:30:41.983598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-AttachVolumeShelveTestJSON-769609988-project May 09 04:30:41.983598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:30:41.983598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:30:41.983598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': 'd10350c6-bf15-414f-9bf7-d371b6912be2'} May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:30:41.984557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:30:41.985993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:41.988557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-96db007d-9175-47b5-8067-f8eee791c92a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Returning 404 to user: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:30:41.989405 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-96db007d-9175-47b5-8067-f8eee791c92a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 404 len: 111 microversion: 2.20 time: 0.044896 May 09 04:30:41.989962 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 310/607] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:41 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 04:30:41.999212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-799bdb62-d73d-4044-938d-bd925640ebf5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '.version_select at 0x7fbfd4444a60>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:42.022415 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-799bdb62-d73d-4044-938d-bd925640ebf5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-475241563" status: 204 len: 0 microversion: 2.20 time: 0.026858 May 09 04:30:42.023735 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 298/608] 10.222.0.44 () {60 vars in 1258 bytes} [Mon May 9 04:30:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-475241563 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 09 04:30:42.680400 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-212ee6f6-2cfa-4e3d-9f0b-f2d9e482cdc3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Action: 'create', calling method: .version_select at 0x7fbfd45cfb80>, body: {"keypair": {"name": "tempest-keypair-864835392"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:42.695356 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-212ee6f6-2cfa-4e3d-9f0b-f2d9e482cdc3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Getting quotas for project 5e56ba7f9cc64897a1d95ac15061e9e4. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:30:42.699350 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-212ee6f6-2cfa-4e3d-9f0b-f2d9e482cdc3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Getting quotas for user 4f8f6c77f898475e8acf1c4042c3928b and project 5e56ba7f9cc64897a1d95ac15061e9e4. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:30:42.867247 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-063fac9b-ca6b-4a3f-910a-3a52d98001fb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:42.868229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-063fac9b-ca6b-4a3f-910a-3a52d98001fb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:42.878261 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-063fac9b-ca6b-4a3f-910a-3a52d98001fb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:42.878917 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-063fac9b-ca6b-4a3f-910a-3a52d98001fb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:42.880452 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-063fac9b-ca6b-4a3f-910a-3a52d98001fb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:42.881249 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-063fac9b-ca6b-4a3f-910a-3a52d98001fb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:42.956897 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-212ee6f6-2cfa-4e3d-9f0b-f2d9e482cdc3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Getting quotas for project 5e56ba7f9cc64897a1d95ac15061e9e4. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:30:42.961393 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-212ee6f6-2cfa-4e3d-9f0b-f2d9e482cdc3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Getting quotas for user 4f8f6c77f898475e8acf1c4042c3928b and project 5e56ba7f9cc64897a1d95ac15061e9e4. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:30:42.975915 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-212ee6f6-2cfa-4e3d-9f0b-f2d9e482cdc3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.300303 May 09 04:30:42.976908 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 311/609] 10.222.0.44 () {62 vars in 1198 bytes} [Mon May 9 04:30:42 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 302 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) May 09 04:30:43.030278 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-063fac9b-ca6b-4a3f-910a-3a52d98001fb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:43.047844 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-063fac9b-ca6b-4a3f-910a-3a52d98001fb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.182389 May 09 04:30:43.049557 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 299/610] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:42 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:44.066560 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8672398a-9ae2-466d-a536-ae2e400bafcc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:44.067383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8672398a-9ae2-466d-a536-ae2e400bafcc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:44.076487 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8672398a-9ae2-466d-a536-ae2e400bafcc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:44.077096 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8672398a-9ae2-466d-a536-ae2e400bafcc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:44.078112 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8672398a-9ae2-466d-a536-ae2e400bafcc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:44.078576 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8672398a-9ae2-466d-a536-ae2e400bafcc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:44.219538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8672398a-9ae2-466d-a536-ae2e400bafcc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:44.230269 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8672398a-9ae2-466d-a536-ae2e400bafcc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.167494 May 09 04:30:44.240435 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 312/611] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:44 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:44.458162 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-853689372", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "01d9e17c-6b96-4039-a582-d98ab8fe7760"}], "security_groups": [{"name": "tempest-securitygroup--2147475270"}], "key_name": "tempest-keypair-864835392", "user_data": "}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:44.567000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] validate_networks() for [('01d9e17c-6b96-4039-a582-d98ab8fe7760', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:30:44.942756 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:30:44.943196 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:30:44.943647 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:30:44.944084 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:30:44.944496 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:30:44.955533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:44.956086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:44.956982 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:44.957510 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:44.976885 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Getting quotas for project 5e56ba7f9cc64897a1d95ac15061e9e4. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:30:44.982278 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Getting quotas for user 4f8f6c77f898475e8acf1c4042c3928b and project 5e56ba7f9cc64897a1d95ac15061e9e4. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:30:44.993926 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:30:44.996253 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:30:45.046147 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-291b9381-1589-47b8-9a06-169b590ca56f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.592252 May 09 04:30:45.046806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 300/612] 10.222.0.44 () {62 vars in 1187 bytes} [Mon May 9 04:30:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 09 04:30:45.056940 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c75c175c-63d7-489c-a87a-7dae7f177367 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:45.057553 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c75c175c-63d7-489c-a87a-7dae7f177367 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:45.117000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c75c175c-63d7-489c-a87a-7dae7f177367 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:45.125608 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c75c175c-63d7-489c-a87a-7dae7f177367 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:45.128070 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c75c175c-63d7-489c-a87a-7dae7f177367 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:45.129194 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c75c175c-63d7-489c-a87a-7dae7f177367 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1280 microversion: 2.20 time: 0.076299 May 09 04:30:45.129774 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 313/613] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:45 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:30:45.247660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7d06a1d9-db9e-4678-9808-ae8c67f31273 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:45.248317 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7d06a1d9-db9e-4678-9808-ae8c67f31273 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:45.254323 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7d06a1d9-db9e-4678-9808-ae8c67f31273 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:45.254765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7d06a1d9-db9e-4678-9808-ae8c67f31273 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:45.255530 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7d06a1d9-db9e-4678-9808-ae8c67f31273 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:45.256064 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7d06a1d9-db9e-4678-9808-ae8c67f31273 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:45.414331 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7d06a1d9-db9e-4678-9808-ae8c67f31273 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:45.428663 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7d06a1d9-db9e-4678-9808-ae8c67f31273 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1735 microversion: 2.1 time: 0.184701 May 09 04:30:45.429688 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 301/614] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:45 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:46.088337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c99e2f16-e698-4b74-a6de-712f5272d452 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:46.088857 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c99e2f16-e698-4b74-a6de-712f5272d452 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:46.097955 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c99e2f16-e698-4b74-a6de-712f5272d452 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.098408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c99e2f16-e698-4b74-a6de-712f5272d452 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.099236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c99e2f16-e698-4b74-a6de-712f5272d452 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.099671 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c99e2f16-e698-4b74-a6de-712f5272d452 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.126164 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c99e2f16-e698-4b74-a6de-712f5272d452 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d/ips" status: 200 len: 149 microversion: 2.1 time: 0.041952 May 09 04:30:46.126775 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 314/615] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 04:30:46 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:30:46.137856 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-71e9f81f-5dc6-47a8-a643-d13be76f4afa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f50c905b-b019-4ab6-aed6-9e06f04287b8"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:46.138983 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-71e9f81f-5dc6-47a8-a643-d13be76f4afa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:46.146255 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-71e9f81f-5dc6-47a8-a643-d13be76f4afa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.146697 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-71e9f81f-5dc6-47a8-a643-d13be76f4afa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.147467 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-71e9f81f-5dc6-47a8-a643-d13be76f4afa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.148123 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-71e9f81f-5dc6-47a8-a643-d13be76f4afa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.153273 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-cb4d9cce-109d-4b18-9325-d72d527849b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:46.153926 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-cb4d9cce-109d-4b18-9325-d72d527849b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:46.160327 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cb4d9cce-109d-4b18-9325-d72d527849b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.160889 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cb4d9cce-109d-4b18-9325-d72d527849b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.161763 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cb4d9cce-109d-4b18-9325-d72d527849b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.162287 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cb4d9cce-109d-4b18-9325-d72d527849b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.239813 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-cb4d9cce-109d-4b18-9325-d72d527849b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:46.250657 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-71e9f81f-5dc6-47a8-a643-d13be76f4afa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] HTTP exception thrown: Invalid volume: volume f50c905b-b019-4ab6-aed6-9e06f04287b8 is already attached to instances: 48735dde-9de8-4b71-877f-e86789f4c887 May 09 04:30:46.251528 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-cb4d9cce-109d-4b18-9325-d72d527849b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-71e9f81f-5dc6-47a8-a643-d13be76f4afa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Request method failure captured: May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: POST /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d/os-volume_attachments HTTP/1.1 May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 74 May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJhTbCVgTT3HZuxvtZpJ_cLiO-p5aO5ZCrkaJhYtCXNfzo_IXS3499vPTrl-cgrMt-SnaVL5V4wtRTXaaPRZskqvbSNvwlk-mrGJOcozoTU2E5zQ45dYOd-AEzlNKKX4qka08Rdzwq7NFgcZCZDko0TOyv7hyBbf4It5Ltr84wDaqIk May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:30:46.252884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:30:46.254359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:30:46.254359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-AttachVolumeNegativeTest-70527954 May 09 04:30:46.254359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:30:46.254359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:30:46.254359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:30:46.254359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:30:46.254359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:30:46.254359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: c56a403eeee84720ba765e2d4367df74 May 09 04:30:46.254359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:30:46.254359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: May 09 04:30:46.254359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {"volumeAttachment": {"volumeId": "f50c905b-b019-4ab6-aed6-9e06f04287b8"}} May 09 04:30:46.254359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Invalid volume: volume f50c905b-b019-4ab6-aed6-9e06f04287b8 is already attached to instances: 48735dde-9de8-4b71-877f-e86789f4c887 May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'server_id': 'c42b820f-fd46-4c3a-bbef-65871250c13d', 'body': {'volumeAttachment': {'volumeId': 'f50c905b-b019-4ab6-aed6-9e06f04287b8'}}} May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f50c905b-b019-4ab6-aed6-9e06f04287b8 is already attached to instances: 48735dde-9de8-4b71-877f-e86789f4c887 May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:30:46.266361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f50c905b-b019-4ab6-aed6-9e06f04287b8 is already attached to instances: 48735dde-9de8-4b71-877f-e86789f4c887 May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:30:46.267806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:30:46.269339 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:30:46.269339 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:30:46.269339 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:30:46.269339 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f50c905b-b019-4ab6-aed6-9e06f04287b8 is already attached to instances: 48735dde-9de8-4b71-877f-e86789f4c887 May 09 04:30:46.269339 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:30:46.269705 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-cb4d9cce-109d-4b18-9325-d72d527849b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:46.269705 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-cb4d9cce-109d-4b18-9325-d72d527849b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1332 microversion: 2.20 time: 0.111879 May 09 04:30:46.269705 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 315/616] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:46 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:30:46.272985 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-71e9f81f-5dc6-47a8-a643-d13be76f4afa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Returning 400 to user: Invalid volume: volume f50c905b-b019-4ab6-aed6-9e06f04287b8 is already attached to instances: 48735dde-9de8-4b71-877f-e86789f4c887 {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:30:46.273853 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-71e9f81f-5dc6-47a8-a643-d13be76f4afa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "POST /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.140675 May 09 04:30:46.274494 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 302/617] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 04:30:46 2022] POST /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d/os-volume_attachments => generated 174 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 04:30:46.284621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a4201700-fbe8-42f1-8cd0-1af7130542d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:46.285416 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a4201700-fbe8-42f1-8cd0-1af7130542d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:46.293391 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a4201700-fbe8-42f1-8cd0-1af7130542d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.293835 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a4201700-fbe8-42f1-8cd0-1af7130542d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.294605 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a4201700-fbe8-42f1-8cd0-1af7130542d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.295212 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a4201700-fbe8-42f1-8cd0-1af7130542d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.328584 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a4201700-fbe8-42f1-8cd0-1af7130542d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Going to try to terminate instance {{(pid=117033) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:30:46.444943 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a4201700-fbe8-42f1-8cd0-1af7130542d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 204 len: 0 microversion: 2.1 time: 0.165097 May 09 04:30:46.445691 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 316/618] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:30:46 2022] DELETE /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 04:30:46.448762 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ff650b72-9c74-4389-9faa-f48e6a80361b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:46.451732 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ff650b72-9c74-4389-9faa-f48e6a80361b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:46.454143 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b4424f6b-e7be-471a-a62b-bc2ec56d9e2f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:46.454845 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b4424f6b-e7be-471a-a62b-bc2ec56d9e2f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:46.461389 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b4424f6b-e7be-471a-a62b-bc2ec56d9e2f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.462363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b4424f6b-e7be-471a-a62b-bc2ec56d9e2f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.463563 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b4424f6b-e7be-471a-a62b-bc2ec56d9e2f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.464040 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b4424f6b-e7be-471a-a62b-bc2ec56d9e2f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.475274 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff650b72-9c74-4389-9faa-f48e6a80361b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.475834 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff650b72-9c74-4389-9faa-f48e6a80361b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.478800 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff650b72-9c74-4389-9faa-f48e6a80361b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.478800 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff650b72-9c74-4389-9faa-f48e6a80361b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.611083 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b4424f6b-e7be-471a-a62b-bc2ec56d9e2f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:46.619498 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b4424f6b-e7be-471a-a62b-bc2ec56d9e2f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1680 microversion: 2.1 time: 0.169541 May 09 04:30:46.621987 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 317/619] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:46 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:46.623568 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ff650b72-9c74-4389-9faa-f48e6a80361b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:46.631749 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ff650b72-9c74-4389-9faa-f48e6a80361b tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1715 microversion: 2.1 time: 0.188828 May 09 04:30:46.632350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 303/620] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:46 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1715 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:46.687529 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ab305e8c-18e9-4bf9-839a-b07e344ca994 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:46.688261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ab305e8c-18e9-4bf9-839a-b07e344ca994 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:46.694534 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ab305e8c-18e9-4bf9-839a-b07e344ca994 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.694984 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ab305e8c-18e9-4bf9-839a-b07e344ca994 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.695755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ab305e8c-18e9-4bf9-839a-b07e344ca994 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.696305 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ab305e8c-18e9-4bf9-839a-b07e344ca994 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.780723 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-ab305e8c-18e9-4bf9-839a-b07e344ca994 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] HTTP exception thrown: Cannot 'detach_volume' instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 while it is in vm_state rescued May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ab305e8c-18e9-4bf9-839a-b07e344ca994 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Request method failure captured: May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: DELETE /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-volume_attachments/0c1ee093-b80f-411a-80bf-f4217df3af70 HTTP/1.1 May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJf7cd7GDKD--ciqHRq6mwpqDN3h9WRQb3Nc7UnOPo5U2WWp_HyVseZh-Z25QJN0hWRsF1_rRoMji4tz5UYqyzyZD9uv_aEy-DLscIeYW26RnR5edf_QFqZ2j-8nWp_I7Woej_Jl3fU2TVCdYMFK88Cwyxa_cQIHDAAuA7M0Y3pC4Zw May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: d28d5139952d450fa3b7da38a62d7a03 May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:30:46.782315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:30:46.783785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:30:46.783785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:30:46.783785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: d28d5139952d450fa3b7da38a62d7a03 May 09 04:30:46.783785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:30:46.783785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-ServerRescueNegativeTestJSON-1341609376-project May 09 04:30:46.783785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:30:46.783785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:30:46.783785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 87b7c3ec77d4493dac92bb61d0b376be May 09 04:30:46.783785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1341609376-project May 09 04:30:46.783785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:30:46.783785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Cannot 'detach_volume' instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 while it is in vm_state rescued May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'server_id': '4473a2d0-b3cc-401b-b460-7c00c66893a0', 'id': '0c1ee093-b80f-411a-80bf-f4217df3af70'} May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:30:46.787829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 while it is in vm_state rescued May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 while it is in vm_state rescued May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:46.789247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ab305e8c-18e9-4bf9-839a-b07e344ca994 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Returning 409 to user: Cannot 'detach_volume' instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 while it is in vm_state rescued {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:30:46.790984 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ab305e8c-18e9-4bf9-839a-b07e344ca994 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-volume_attachments/0c1ee093-b80f-411a-80bf-f4217df3af70" status: 409 len: 152 microversion: 2.1 time: 0.100187 May 09 04:30:46.790984 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 318/621] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 04:30:46 2022] DELETE /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-volume_attachments/0c1ee093-b80f-411a-80bf-f4217df3af70 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 09 04:30:46.793537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b5ee2854-801c-4610-9792-d6674771f80a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:46.794072 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b5ee2854-801c-4610-9792-d6674771f80a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:46.800222 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5ee2854-801c-4610-9792-d6674771f80a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.800852 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5ee2854-801c-4610-9792-d6674771f80a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.801618 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5ee2854-801c-4610-9792-d6674771f80a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.802046 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5ee2854-801c-4610-9792-d6674771f80a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.872400 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b5ee2854-801c-4610-9792-d6674771f80a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "POST /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/action" status: 202 len: 0 microversion: 2.1 time: 0.083324 May 09 04:30:46.875943 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 304/622] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 04:30:46 2022] POST /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:30:46.882021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-705b2003-b2f1-4d64-8785-22f83815f11a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:46.882630 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-705b2003-b2f1-4d64-8785-22f83815f11a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:46.889808 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-705b2003-b2f1-4d64-8785-22f83815f11a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.890285 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-705b2003-b2f1-4d64-8785-22f83815f11a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:46.891082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-705b2003-b2f1-4d64-8785-22f83815f11a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:46.891512 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-705b2003-b2f1-4d64-8785-22f83815f11a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:47.028938 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-705b2003-b2f1-4d64-8785-22f83815f11a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:47.037250 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-705b2003-b2f1-4d64-8785-22f83815f11a tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1723 microversion: 2.1 time: 0.159361 May 09 04:30:47.037818 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 319/623] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:46 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:47.275588 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d649d227-317c-4a47-bde8-df751c81e26d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:47.276313 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d649d227-317c-4a47-bde8-df751c81e26d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:47.282772 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d649d227-317c-4a47-bde8-df751c81e26d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:47.283333 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d649d227-317c-4a47-bde8-df751c81e26d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:47.284128 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d649d227-317c-4a47-bde8-df751c81e26d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:47.284562 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d649d227-317c-4a47-bde8-df751c81e26d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:47.348083 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d649d227-317c-4a47-bde8-df751c81e26d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:47.363320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d649d227-317c-4a47-bde8-df751c81e26d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:47.364854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d649d227-317c-4a47-bde8-df751c81e26d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:47.366031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d649d227-317c-4a47-bde8-df751c81e26d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1338 microversion: 2.20 time: 0.095963 May 09 04:30:47.366592 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 305/624] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:47 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1338 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:30:47.637598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-fd240f2f-b0a3-4f98-af3e-81ec9cba49d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:47.638160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-fd240f2f-b0a3-4f98-af3e-81ec9cba49d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:47.644780 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fd240f2f-b0a3-4f98-af3e-81ec9cba49d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:47.645237 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fd240f2f-b0a3-4f98-af3e-81ec9cba49d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:47.646015 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fd240f2f-b0a3-4f98-af3e-81ec9cba49d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:47.646455 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fd240f2f-b0a3-4f98-af3e-81ec9cba49d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:47.860494 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-fd240f2f-b0a3-4f98-af3e-81ec9cba49d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:47.869458 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-fd240f2f-b0a3-4f98-af3e-81ec9cba49d2 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1680 microversion: 2.1 time: 0.236218 May 09 04:30:47.870537 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 320/625] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:47 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:48.054829 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fef22d4e-893c-48a1-a978-307872bc04b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:48.055630 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fef22d4e-893c-48a1-a978-307872bc04b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:48.063430 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fef22d4e-893c-48a1-a978-307872bc04b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:48.065656 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fef22d4e-893c-48a1-a978-307872bc04b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:48.066650 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fef22d4e-893c-48a1-a978-307872bc04b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:48.067345 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fef22d4e-893c-48a1-a978-307872bc04b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:48.385921 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d47c57e6-3bcf-4198-b5c5-642a94ae3235 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:48.386542 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d47c57e6-3bcf-4198-b5c5-642a94ae3235 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:48.396304 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d47c57e6-3bcf-4198-b5c5-642a94ae3235 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:48.398504 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d47c57e6-3bcf-4198-b5c5-642a94ae3235 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:48.399823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d47c57e6-3bcf-4198-b5c5-642a94ae3235 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:48.400518 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d47c57e6-3bcf-4198-b5c5-642a94ae3235 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:48.496068 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fef22d4e-893c-48a1-a978-307872bc04b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:48.508626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fef22d4e-893c-48a1-a978-307872bc04b5 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1723 microversion: 2.1 time: 0.456988 May 09 04:30:48.511952 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 306/626] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:48 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1723 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:48.889255 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d1909c91-87da-4888-9ffa-5b5076aa800f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:48.890192 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d1909c91-87da-4888-9ffa-5b5076aa800f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:48.900682 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d1909c91-87da-4888-9ffa-5b5076aa800f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:48.901426 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d1909c91-87da-4888-9ffa-5b5076aa800f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:48.902461 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d1909c91-87da-4888-9ffa-5b5076aa800f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:48.903059 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d1909c91-87da-4888-9ffa-5b5076aa800f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:48.956681 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d47c57e6-3bcf-4198-b5c5-642a94ae3235 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:48.970661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d47c57e6-3bcf-4198-b5c5-642a94ae3235 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:48.972611 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d47c57e6-3bcf-4198-b5c5-642a94ae3235 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:48.974016 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d47c57e6-3bcf-4198-b5c5-642a94ae3235 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1406 microversion: 2.20 time: 0.592311 May 09 04:30:48.975669 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 321/627] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:48 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1406 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:30:49.372438 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-d6393f3c-9d20-4537-b9a5-4def012441fe req-f468e10b-17ad-4371-8fce-e22479533cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96f5900f-cb8a-485d-866b-580b188cc09c", "tag": "374d080b-906f-4857-97aa-846916239632"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:49.387097 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-d6393f3c-9d20-4537-b9a5-4def012441fe req-f468e10b-17ad-4371-8fce-e22479533cd4 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:49.387636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-d6393f3c-9d20-4537-b9a5-4def012441fe req-f468e10b-17ad-4371-8fce-e22479533cd4 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:49.420508 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-d6393f3c-9d20-4537-b9a5-4def012441fe req-f468e10b-17ad-4371-8fce-e22479533cd4 service nova] Creating event network-changed:374d080b-906f-4857-97aa-846916239632 for instance 96f5900f-cb8a-485d-866b-580b188cc09c on hv-cinder-83800 May 09 04:30:49.436559 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-d6393f3c-9d20-4537-b9a5-4def012441fe req-f468e10b-17ad-4371-8fce-e22479533cd4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068576 May 09 04:30:49.437164 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 322/628] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:30:49.530012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c1d4c236-e1ab-49fb-875c-95e8bc71efeb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:49.530714 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c1d4c236-e1ab-49fb-875c-95e8bc71efeb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:49.545060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c1d4c236-e1ab-49fb-875c-95e8bc71efeb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:49.546122 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c1d4c236-e1ab-49fb-875c-95e8bc71efeb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:49.547110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c1d4c236-e1ab-49fb-875c-95e8bc71efeb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:49.547723 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c1d4c236-e1ab-49fb-875c-95e8bc71efeb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:49.558279 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d1909c91-87da-4888-9ffa-5b5076aa800f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:49.567501 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d1909c91-87da-4888-9ffa-5b5076aa800f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1680 microversion: 2.1 time: 0.684618 May 09 04:30:49.580941 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 307/629] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:48 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1680 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:49.835773 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c1d4c236-e1ab-49fb-875c-95e8bc71efeb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:49.850240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c1d4c236-e1ab-49fb-875c-95e8bc71efeb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1723 microversion: 2.1 time: 0.325090 May 09 04:30:49.852994 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 323/630] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:49 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:49.993513 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-776368bb-6621-468a-9dff-5489235f6946 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:49.994128 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-776368bb-6621-468a-9dff-5489235f6946 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:50.000583 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-776368bb-6621-468a-9dff-5489235f6946 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:50.001258 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-776368bb-6621-468a-9dff-5489235f6946 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:50.001974 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-776368bb-6621-468a-9dff-5489235f6946 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:50.002461 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-776368bb-6621-468a-9dff-5489235f6946 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:50.120590 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-879366a5-fabf-44d3-990e-593fb94d3f72 req-1897f84e-cd61-49a7-b36b-df57ca2735a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42b820f-fd46-4c3a-bbef-65871250c13d", "name": "network-vif-deleted", "tag": "e9b357da-dcf1-479a-8514-427749cafd62"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:50.132185 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-879366a5-fabf-44d3-990e-593fb94d3f72 req-1897f84e-cd61-49a7-b36b-df57ca2735a5 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:50.132626 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-879366a5-fabf-44d3-990e-593fb94d3f72 req-1897f84e-cd61-49a7-b36b-df57ca2735a5 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:50.157050 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-879366a5-fabf-44d3-990e-593fb94d3f72 req-1897f84e-cd61-49a7-b36b-df57ca2735a5 service nova] Creating event network-vif-deleted:e9b357da-dcf1-479a-8514-427749cafd62 for instance c42b820f-fd46-4c3a-bbef-65871250c13d on hv-cinder-83800 May 09 04:30:50.165732 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-879366a5-fabf-44d3-990e-593fb94d3f72 req-1897f84e-cd61-49a7-b36b-df57ca2735a5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046243 May 09 04:30:50.166930 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 324/631] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:30:50.226887 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-776368bb-6621-468a-9dff-5489235f6946 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:50.237329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-776368bb-6621-468a-9dff-5489235f6946 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:50.239463 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-776368bb-6621-468a-9dff-5489235f6946 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:50.244068 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-776368bb-6621-468a-9dff-5489235f6946 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1406 microversion: 2.20 time: 0.254386 May 09 04:30:50.244611 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 308/632] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:49 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:30:50.587280 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-469db1e2-a8a7-4ef7-a99f-3ea0ba245086 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:50.588345 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-469db1e2-a8a7-4ef7-a99f-3ea0ba245086 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:50.595007 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-469db1e2-a8a7-4ef7-a99f-3ea0ba245086 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:50.595540 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-469db1e2-a8a7-4ef7-a99f-3ea0ba245086 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:50.596364 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-469db1e2-a8a7-4ef7-a99f-3ea0ba245086 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:50.596849 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-469db1e2-a8a7-4ef7-a99f-3ea0ba245086 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:50.672734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-469db1e2-a8a7-4ef7-a99f-3ea0ba245086 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:50.684692 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-469db1e2-a8a7-4ef7-a99f-3ea0ba245086 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1612 microversion: 2.1 time: 0.101901 May 09 04:30:50.696086 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 325/633] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:50 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1612 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:50.869399 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-510f8716-cbd9-4837-a701-a089f76f3271 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:50.870032 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-510f8716-cbd9-4837-a701-a089f76f3271 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:50.881090 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-510f8716-cbd9-4837-a701-a089f76f3271 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:50.881725 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-510f8716-cbd9-4837-a701-a089f76f3271 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:50.882922 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-510f8716-cbd9-4837-a701-a089f76f3271 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:50.884476 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-510f8716-cbd9-4837-a701-a089f76f3271 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:51.032114 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-510f8716-cbd9-4837-a701-a089f76f3271 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:51.040646 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-510f8716-cbd9-4837-a701-a089f76f3271 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1723 microversion: 2.1 time: 0.175828 May 09 04:30:51.041600 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 309/634] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:50 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:51.264881 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-9e194cbf-f276-4b0f-af58-cc1f70090f02 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:51.267090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-9e194cbf-f276-4b0f-af58-cc1f70090f02 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:51.275312 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9e194cbf-f276-4b0f-af58-cc1f70090f02 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:51.276079 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9e194cbf-f276-4b0f-af58-cc1f70090f02 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:51.277111 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9e194cbf-f276-4b0f-af58-cc1f70090f02 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:51.278439 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9e194cbf-f276-4b0f-af58-cc1f70090f02 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:51.451464 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9e194cbf-f276-4b0f-af58-cc1f70090f02 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:51.459297 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9e194cbf-f276-4b0f-af58-cc1f70090f02 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:51.460958 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9e194cbf-f276-4b0f-af58-cc1f70090f02 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:51.462154 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-9e194cbf-f276-4b0f-af58-cc1f70090f02 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1406 microversion: 2.20 time: 0.201006 May 09 04:30:51.462968 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 326/635] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:51 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:30:51.703231 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c60438b2-b221-4ddb-8f37-cac0444af483 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:51.704400 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c60438b2-b221-4ddb-8f37-cac0444af483 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:51.710707 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c60438b2-b221-4ddb-8f37-cac0444af483 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:51.711248 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c60438b2-b221-4ddb-8f37-cac0444af483 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:51.713025 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c60438b2-b221-4ddb-8f37-cac0444af483 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:51.713631 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c60438b2-b221-4ddb-8f37-cac0444af483 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:51.745368 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c60438b2-b221-4ddb-8f37-cac0444af483 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:51.745896 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c60438b2-b221-4ddb-8f37-cac0444af483 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:51.746412 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-c60438b2-b221-4ddb-8f37-cac0444af483 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lazy-loading 'fault' on Instance uuid c42b820f-fd46-4c3a-bbef-65871250c13d {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:30:51.790936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c60438b2-b221-4ddb-8f37-cac0444af483 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:51.798135 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c60438b2-b221-4ddb-8f37-cac0444af483 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1330 microversion: 2.1 time: 0.099367 May 09 04:30:51.798701 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 310/636] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:51 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:52.058045 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e3e9dbf5-b0f3-4fe0-9a5a-5d485f80f0b0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:52.058663 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e3e9dbf5-b0f3-4fe0-9a5a-5d485f80f0b0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:52.065547 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e3e9dbf5-b0f3-4fe0-9a5a-5d485f80f0b0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:52.066312 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e3e9dbf5-b0f3-4fe0-9a5a-5d485f80f0b0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:52.067087 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e3e9dbf5-b0f3-4fe0-9a5a-5d485f80f0b0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:52.067532 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e3e9dbf5-b0f3-4fe0-9a5a-5d485f80f0b0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:52.197228 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e3e9dbf5-b0f3-4fe0-9a5a-5d485f80f0b0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:52.205122 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e3e9dbf5-b0f3-4fe0-9a5a-5d485f80f0b0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1723 microversion: 2.1 time: 0.151438 May 09 04:30:52.205682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 327/637] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:52 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:52.481288 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3f1f0ecb-2148-46f5-abcc-f7a42c35a7e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:52.481897 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3f1f0ecb-2148-46f5-abcc-f7a42c35a7e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:52.488314 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f1f0ecb-2148-46f5-abcc-f7a42c35a7e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:52.488759 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f1f0ecb-2148-46f5-abcc-f7a42c35a7e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:52.489515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f1f0ecb-2148-46f5-abcc-f7a42c35a7e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:52.489946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f1f0ecb-2148-46f5-abcc-f7a42c35a7e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:52.627636 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3f1f0ecb-2148-46f5-abcc-f7a42c35a7e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:52.635456 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3f1f0ecb-2148-46f5-abcc-f7a42c35a7e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:52.636992 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3f1f0ecb-2148-46f5-abcc-f7a42c35a7e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:52.638093 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3f1f0ecb-2148-46f5-abcc-f7a42c35a7e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1406 microversion: 2.20 time: 0.161425 May 09 04:30:52.638651 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 311/638] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:52 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:30:52.814530 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8e794613-9f5f-455b-bb67-075188ad9386 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:52.815148 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8e794613-9f5f-455b-bb67-075188ad9386 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:52.821666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8e794613-9f5f-455b-bb67-075188ad9386 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:52.822116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8e794613-9f5f-455b-bb67-075188ad9386 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:52.822885 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8e794613-9f5f-455b-bb67-075188ad9386 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:52.823318 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8e794613-9f5f-455b-bb67-075188ad9386 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:52.853788 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8e794613-9f5f-455b-bb67-075188ad9386 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:52.854232 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8e794613-9f5f-455b-bb67-075188ad9386 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:52.854677 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.objects.instance [None req-8e794613-9f5f-455b-bb67-075188ad9386 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lazy-loading 'fault' on Instance uuid c42b820f-fd46-4c3a-bbef-65871250c13d {{(pid=117033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:30:52.902643 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8e794613-9f5f-455b-bb67-075188ad9386 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:52.910384 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8e794613-9f5f-455b-bb67-075188ad9386 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 200 len: 1330 microversion: 2.1 time: 0.099708 May 09 04:30:52.910955 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 328/639] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:52 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:53.222347 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-21d75e30-5df6-4a3e-b758-60d0047256ba tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:53.222950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-21d75e30-5df6-4a3e-b758-60d0047256ba tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:53.229184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-21d75e30-5df6-4a3e-b758-60d0047256ba tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:53.229630 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-21d75e30-5df6-4a3e-b758-60d0047256ba tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:53.230390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-21d75e30-5df6-4a3e-b758-60d0047256ba tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:53.230820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-21d75e30-5df6-4a3e-b758-60d0047256ba tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:53.372311 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-21d75e30-5df6-4a3e-b758-60d0047256ba tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:53.382836 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-21d75e30-5df6-4a3e-b758-60d0047256ba tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1729 microversion: 2.1 time: 0.164105 May 09 04:30:53.383719 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 312/640] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:53 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:53.400728 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a7f0351d-9386-4e08-b1a2-0fe97c9cef56 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:53.401245 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a7f0351d-9386-4e08-b1a2-0fe97c9cef56 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:53.412028 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7f0351d-9386-4e08-b1a2-0fe97c9cef56 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:53.412733 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7f0351d-9386-4e08-b1a2-0fe97c9cef56 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:53.413521 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7f0351d-9386-4e08-b1a2-0fe97c9cef56 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:53.413969 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7f0351d-9386-4e08-b1a2-0fe97c9cef56 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:53.564165 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a7f0351d-9386-4e08-b1a2-0fe97c9cef56 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.167487 May 09 04:30:53.564988 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 329/641] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 04:30:53 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:30:53.655273 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1d52e507-dd83-4ea7-a31e-e67c4e3b68f1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:53.656059 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1d52e507-dd83-4ea7-a31e-e67c4e3b68f1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:53.662386 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1d52e507-dd83-4ea7-a31e-e67c4e3b68f1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:53.662836 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1d52e507-dd83-4ea7-a31e-e67c4e3b68f1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:53.663598 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1d52e507-dd83-4ea7-a31e-e67c4e3b68f1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:53.664070 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1d52e507-dd83-4ea7-a31e-e67c4e3b68f1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:53.899649 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1d52e507-dd83-4ea7-a31e-e67c4e3b68f1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:53.907609 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1d52e507-dd83-4ea7-a31e-e67c4e3b68f1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:53.909153 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1d52e507-dd83-4ea7-a31e-e67c4e3b68f1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:53.910305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1d52e507-dd83-4ea7-a31e-e67c4e3b68f1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1406 microversion: 2.20 time: 0.258933 May 09 04:30:53.910870 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 313/642] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:53 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:30:53.926604 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-231f13bb-187f-4da0-8114-241feb044abd tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:53.927338 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-231f13bb-187f-4da0-8114-241feb044abd tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:53.933953 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-231f13bb-187f-4da0-8114-241feb044abd tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:53.934482 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-231f13bb-187f-4da0-8114-241feb044abd tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:53.935330 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-231f13bb-187f-4da0-8114-241feb044abd tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:53.935775 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-231f13bb-187f-4da0-8114-241feb044abd tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:53.949243 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-231f13bb-187f-4da0-8114-241feb044abd tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] HTTP exception thrown: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-231f13bb-187f-4da0-8114-241feb044abd tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Request method failure captured: May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d HTTP/1.1 May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJhTbCVgTT3HZuxvtZpJ_cLiO-p5aO5ZCrkaJhYtCXNfzo_IXS3499vPTrl-cgrMt-SnaVL5V4wtRTXaaPRZskqvbSNvwlk-mrGJOcozoTU2E5zQ45dYOd-AEzlNKKX4qka08Rdzwq7NFgcZCZDko0TOyv7hyBbf4It5Ltr84wDaqIk May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:30:53.950928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:30:53.952486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:30:53.952486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-AttachVolumeNegativeTest-70527954 May 09 04:30:53.952486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:30:53.952486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:30:53.952486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:30:53.952486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:30:53.952486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:30:53.952486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: c56a403eeee84720ba765e2d4367df74 May 09 04:30:53.952486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:30:53.952486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:30:53.952486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:30:53.952486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': 'c42b820f-fd46-4c3a-bbef-65871250c13d'} May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:30:53.953290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:30:53.954408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:30:53.955405 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-231f13bb-187f-4da0-8114-241feb044abd tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Returning 404 to user: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:30:53.955405 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-231f13bb-187f-4da0-8114-241feb044abd tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 404 len: 111 microversion: 2.1 time: 0.029655 May 09 04:30:53.955405 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 330/643] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:53 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:30:53.961076 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fa5384d1-7929-45a1-9218-fcba0946ff7f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '.version_select at 0x7fbfd43bcf70>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:53.980517 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fa5384d1-7929-45a1-9218-fcba0946ff7f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-249584293" status: 202 len: 0 microversion: 2.1 time: 0.022993 May 09 04:30:53.981312 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 314/644] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 9 04:30:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-249584293 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 04:30:54.626855 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-5e3b48b7-6d4b-4241-9813-d32661377c3e req-c5277f9e-d2ed-4c27-9c31-6548f472e094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4473a2d0-b3cc-401b-b460-7c00c66893a0", "tag": "ef4e419e-4415-4b7c-b72d-4dbd68f98b15"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:54.642208 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-5e3b48b7-6d4b-4241-9813-d32661377c3e req-c5277f9e-d2ed-4c27-9c31-6548f472e094 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:54.642871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-5e3b48b7-6d4b-4241-9813-d32661377c3e req-c5277f9e-d2ed-4c27-9c31-6548f472e094 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:54.663587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-5e3b48b7-6d4b-4241-9813-d32661377c3e req-c5277f9e-d2ed-4c27-9c31-6548f472e094 service nova] Creating event network-changed:ef4e419e-4415-4b7c-b72d-4dbd68f98b15 for instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 on hv-cinder-83800 May 09 04:30:54.672357 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-5e3b48b7-6d4b-4241-9813-d32661377c3e req-c5277f9e-d2ed-4c27-9c31-6548f472e094 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048674 May 09 04:30:54.673308 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 331/645] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:30:54.688863 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-650325ca-869d-4c10-85ae-de8aa4547f9b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:54.689939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-650325ca-869d-4c10-85ae-de8aa4547f9b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:54.696315 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-650325ca-869d-4c10-85ae-de8aa4547f9b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:54.697087 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-650325ca-869d-4c10-85ae-de8aa4547f9b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:54.698022 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-650325ca-869d-4c10-85ae-de8aa4547f9b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:54.698608 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-650325ca-869d-4c10-85ae-de8aa4547f9b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:54.793132 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-650325ca-869d-4c10-85ae-de8aa4547f9b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lazy-loading 'services' on Instance uuid 48735dde-9de8-4b71-877f-e86789f4c887 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:30:54.871698 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-650325ca-869d-4c10-85ae-de8aa4547f9b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887/os-volume_attachments/f50c905b-b019-4ab6-aed6-9e06f04287b8" status: 202 len: 0 microversion: 2.1 time: 0.188064 May 09 04:30:54.872569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 315/646] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 04:30:54 2022] DELETE /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887/os-volume_attachments/f50c905b-b019-4ab6-aed6-9e06f04287b8 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:30:54.881602 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5246db73-bc47-4cdd-b2f1-a5a6808edc8d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:54.883049 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5246db73-bc47-4cdd-b2f1-a5a6808edc8d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:54.890011 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5246db73-bc47-4cdd-b2f1-a5a6808edc8d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:54.890710 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5246db73-bc47-4cdd-b2f1-a5a6808edc8d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:54.891667 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5246db73-bc47-4cdd-b2f1-a5a6808edc8d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:54.892440 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5246db73-bc47-4cdd-b2f1-a5a6808edc8d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:54.929408 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5b14f601-e5c5-46c5-8eab-8cc0c76d0e5a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:54.930118 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5b14f601-e5c5-46c5-8eab-8cc0c76d0e5a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:54.937000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b14f601-e5c5-46c5-8eab-8cc0c76d0e5a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:54.937455 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b14f601-e5c5-46c5-8eab-8cc0c76d0e5a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:54.938220 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b14f601-e5c5-46c5-8eab-8cc0c76d0e5a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:54.938653 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b14f601-e5c5-46c5-8eab-8cc0c76d0e5a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:54.942917 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5246db73-bc47-4cdd-b2f1-a5a6808edc8d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056917 May 09 04:30:54.944460 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 332/647] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:30:54 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:30:55.076813 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5b14f601-e5c5-46c5-8eab-8cc0c76d0e5a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:55.084574 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5b14f601-e5c5-46c5-8eab-8cc0c76d0e5a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:55.086168 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5b14f601-e5c5-46c5-8eab-8cc0c76d0e5a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:55.088377 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5b14f601-e5c5-46c5-8eab-8cc0c76d0e5a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1406 microversion: 2.20 time: 0.162857 May 09 04:30:55.088974 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 316/648] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:54 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:30:55.954701 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c4613e53-f53b-4ba2-aa4f-79cf4f24eced tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:55.955557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c4613e53-f53b-4ba2-aa4f-79cf4f24eced tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:55.962163 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c4613e53-f53b-4ba2-aa4f-79cf4f24eced tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:55.962877 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c4613e53-f53b-4ba2-aa4f-79cf4f24eced tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:55.963642 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c4613e53-f53b-4ba2-aa4f-79cf4f24eced tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:55.964107 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c4613e53-f53b-4ba2-aa4f-79cf4f24eced tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:55.992393 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c4613e53-f53b-4ba2-aa4f-79cf4f24eced tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041622 May 09 04:30:55.992991 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 333/649] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:30:55 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 04:30:56.051326 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-73da4f42-584e-452b-beb8-14d84cc79a60 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:56.051870 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-73da4f42-584e-452b-beb8-14d84cc79a60 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:56.058424 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73da4f42-584e-452b-beb8-14d84cc79a60 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:56.058874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73da4f42-584e-452b-beb8-14d84cc79a60 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:56.059635 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73da4f42-584e-452b-beb8-14d84cc79a60 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:56.060130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73da4f42-584e-452b-beb8-14d84cc79a60 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:56.084527 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-73da4f42-584e-452b-beb8-14d84cc79a60 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:30:56.106756 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d3f6b48a-ca73-4a50-8996-3f7ea023095b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:56.107553 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d3f6b48a-ca73-4a50-8996-3f7ea023095b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:56.113767 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d3f6b48a-ca73-4a50-8996-3f7ea023095b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:56.114300 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d3f6b48a-ca73-4a50-8996-3f7ea023095b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:56.115257 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d3f6b48a-ca73-4a50-8996-3f7ea023095b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:56.115701 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d3f6b48a-ca73-4a50-8996-3f7ea023095b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:56.193338 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-73da4f42-584e-452b-beb8-14d84cc79a60 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 204 len: 0 microversion: 2.1 time: 0.145500 May 09 04:30:56.194381 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 317/650] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:30:56 2022] DELETE /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 04:30:56.200516 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-9fb09c3b-6e6a-4c73-b05f-f04b7c15e30d req-ab403ac8-687e-4f53-ac22-ba3c155fde5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f5900f-cb8a-485d-866b-580b188cc09c", "name": "network-vif-plugged", "status": "completed", "tag": "374d080b-906f-4857-97aa-846916239632"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:56.208639 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-9fb09c3b-6e6a-4c73-b05f-f04b7c15e30d req-ab403ac8-687e-4f53-ac22-ba3c155fde5a service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:56.209008 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-9fb09c3b-6e6a-4c73-b05f-f04b7c15e30d req-ab403ac8-687e-4f53-ac22-ba3c155fde5a service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:56.221090 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-9fb09c3b-6e6a-4c73-b05f-f04b7c15e30d req-ab403ac8-687e-4f53-ac22-ba3c155fde5a service nova] Creating event network-vif-plugged:374d080b-906f-4857-97aa-846916239632 for instance 96f5900f-cb8a-485d-866b-580b188cc09c on hv-cinder-83800 May 09 04:30:56.225685 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-9fb09c3b-6e6a-4c73-b05f-f04b7c15e30d req-ab403ac8-687e-4f53-ac22-ba3c155fde5a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029818 May 09 04:30:56.226282 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 318/651] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:30:56.232837 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f39d9d68-24b4-46da-87ef-f95b1bad7c4b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:56.233562 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f39d9d68-24b4-46da-87ef-f95b1bad7c4b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:56.239545 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f39d9d68-24b4-46da-87ef-f95b1bad7c4b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:56.240023 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f39d9d68-24b4-46da-87ef-f95b1bad7c4b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:56.240790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f39d9d68-24b4-46da-87ef-f95b1bad7c4b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:56.241227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f39d9d68-24b4-46da-87ef-f95b1bad7c4b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:56.273444 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d3f6b48a-ca73-4a50-8996-3f7ea023095b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:56.282214 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d3f6b48a-ca73-4a50-8996-3f7ea023095b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:56.283717 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d3f6b48a-ca73-4a50-8996-3f7ea023095b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:56.284891 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d3f6b48a-ca73-4a50-8996-3f7ea023095b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1406 microversion: 2.20 time: 0.182647 May 09 04:30:56.285459 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 334/652] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:56 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:30:56.373623 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f39d9d68-24b4-46da-87ef-f95b1bad7c4b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:56.380890 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f39d9d68-24b4-46da-87ef-f95b1bad7c4b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1681 microversion: 2.1 time: 0.153531 May 09 04:30:56.381459 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 319/653] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:56 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:30:56.686988 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-bc4d385f-d28e-4cfd-9653-38c3b43fa7e6 req-9c50075d-095d-480d-b7bd-757fdb5c4086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4473a2d0-b3cc-401b-b460-7c00c66893a0", "tag": "ef4e419e-4415-4b7c-b72d-4dbd68f98b15"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:56.695088 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-bc4d385f-d28e-4cfd-9653-38c3b43fa7e6 req-9c50075d-095d-480d-b7bd-757fdb5c4086 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:56.695529 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-bc4d385f-d28e-4cfd-9653-38c3b43fa7e6 req-9c50075d-095d-480d-b7bd-757fdb5c4086 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:56.706955 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-bc4d385f-d28e-4cfd-9653-38c3b43fa7e6 req-9c50075d-095d-480d-b7bd-757fdb5c4086 service nova] Creating event network-changed:ef4e419e-4415-4b7c-b72d-4dbd68f98b15 for instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 on hv-cinder-83800 May 09 04:30:56.712510 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-bc4d385f-d28e-4cfd-9653-38c3b43fa7e6 req-9c50075d-095d-480d-b7bd-757fdb5c4086 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028471 May 09 04:30:56.713349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 335/654] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:30:57.302614 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-678e5b8b-b56b-422c-9dd2-e0e6c5b618e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:57.303219 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-678e5b8b-b56b-422c-9dd2-e0e6c5b618e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:57.310308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-678e5b8b-b56b-422c-9dd2-e0e6c5b618e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:57.310747 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-678e5b8b-b56b-422c-9dd2-e0e6c5b618e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:57.311557 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-678e5b8b-b56b-422c-9dd2-e0e6c5b618e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:57.312013 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-678e5b8b-b56b-422c-9dd2-e0e6c5b618e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:57.398901 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ce0069e1-5a68-4d5a-9ad2-7cdbeeff4035 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:57.399601 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ce0069e1-5a68-4d5a-9ad2-7cdbeeff4035 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:57.405718 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ce0069e1-5a68-4d5a-9ad2-7cdbeeff4035 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:57.406166 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ce0069e1-5a68-4d5a-9ad2-7cdbeeff4035 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:57.406936 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ce0069e1-5a68-4d5a-9ad2-7cdbeeff4035 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:57.407374 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ce0069e1-5a68-4d5a-9ad2-7cdbeeff4035 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:57.438435 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-678e5b8b-b56b-422c-9dd2-e0e6c5b618e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:57.446325 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-678e5b8b-b56b-422c-9dd2-e0e6c5b618e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:57.447873 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-678e5b8b-b56b-422c-9dd2-e0e6c5b618e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:57.449006 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-678e5b8b-b56b-422c-9dd2-e0e6c5b618e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1406 microversion: 2.20 time: 0.150381 May 09 04:30:57.449575 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 320/655] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:57 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:30:57.541436 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ce0069e1-5a68-4d5a-9ad2-7cdbeeff4035 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:57.549476 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ce0069e1-5a68-4d5a-9ad2-7cdbeeff4035 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1681 microversion: 2.1 time: 0.155134 May 09 04:30:57.550070 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 336/656] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:57 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:58.467564 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ebe9ad00-7e7a-444c-84e5-323dc0ec9c0f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:58.468222 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ebe9ad00-7e7a-444c-84e5-323dc0ec9c0f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:58.475048 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebe9ad00-7e7a-444c-84e5-323dc0ec9c0f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:58.475592 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebe9ad00-7e7a-444c-84e5-323dc0ec9c0f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:58.476513 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebe9ad00-7e7a-444c-84e5-323dc0ec9c0f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:58.476941 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebe9ad00-7e7a-444c-84e5-323dc0ec9c0f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:58.566583 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-72763533-0f32-4142-8766-433d42e89fc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:58.567296 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-72763533-0f32-4142-8766-433d42e89fc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:58.573955 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-72763533-0f32-4142-8766-433d42e89fc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:58.574636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-72763533-0f32-4142-8766-433d42e89fc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:58.575568 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-72763533-0f32-4142-8766-433d42e89fc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:58.576193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-72763533-0f32-4142-8766-433d42e89fc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:58.679832 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ebe9ad00-7e7a-444c-84e5-323dc0ec9c0f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:58.688069 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ebe9ad00-7e7a-444c-84e5-323dc0ec9c0f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:58.689965 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ebe9ad00-7e7a-444c-84e5-323dc0ec9c0f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:58.691214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ebe9ad00-7e7a-444c-84e5-323dc0ec9c0f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1406 microversion: 2.20 time: 0.227695 May 09 04:30:58.692063 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 321/657] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:58 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:30:58.716435 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-72763533-0f32-4142-8766-433d42e89fc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:58.723957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-72763533-0f32-4142-8766-433d42e89fc5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1681 microversion: 2.1 time: 0.161191 May 09 04:30:58.724721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 337/658] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:58 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:59.018436 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-62caddaf-1f64-4fd3-b797-42f8b0b9d5bb req-7fd8e60e-d28c-4d59-9769-a834fb91f7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48735dde-9de8-4b71-877f-e86789f4c887", "name": "network-vif-deleted", "tag": "1e27a9e1-6f10-43bb-909c-aa9fc82bc83c"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:30:59.027373 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-62caddaf-1f64-4fd3-b797-42f8b0b9d5bb req-7fd8e60e-d28c-4d59-9769-a834fb91f7b6 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:59.027831 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-62caddaf-1f64-4fd3-b797-42f8b0b9d5bb req-7fd8e60e-d28c-4d59-9769-a834fb91f7b6 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:59.042226 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-62caddaf-1f64-4fd3-b797-42f8b0b9d5bb req-7fd8e60e-d28c-4d59-9769-a834fb91f7b6 service nova] Creating event network-vif-deleted:1e27a9e1-6f10-43bb-909c-aa9fc82bc83c for instance 48735dde-9de8-4b71-877f-e86789f4c887 on hv-cinder-83800 May 09 04:30:59.048130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-62caddaf-1f64-4fd3-b797-42f8b0b9d5bb req-7fd8e60e-d28c-4d59-9769-a834fb91f7b6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033530 May 09 04:30:59.049080 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 322/659] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:30:59.709476 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-17f5da93-8777-488f-8fdb-4e3b2f04d593 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:59.710069 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-17f5da93-8777-488f-8fdb-4e3b2f04d593 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:59.717656 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-17f5da93-8777-488f-8fdb-4e3b2f04d593 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:59.718128 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-17f5da93-8777-488f-8fdb-4e3b2f04d593 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:59.718935 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-17f5da93-8777-488f-8fdb-4e3b2f04d593 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:59.719407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-17f5da93-8777-488f-8fdb-4e3b2f04d593 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:59.749808 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5e085d66-2f54-48d9-ba24-57045ed6cee5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:30:59.750763 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5e085d66-2f54-48d9-ba24-57045ed6cee5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:30:59.762968 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5e085d66-2f54-48d9-ba24-57045ed6cee5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:59.763421 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5e085d66-2f54-48d9-ba24-57045ed6cee5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:59.764342 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5e085d66-2f54-48d9-ba24-57045ed6cee5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:59.764782 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5e085d66-2f54-48d9-ba24-57045ed6cee5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:59.800027 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5e085d66-2f54-48d9-ba24-57045ed6cee5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:30:59.800742 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5e085d66-2f54-48d9-ba24-57045ed6cee5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:30:59.801375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-5e085d66-2f54-48d9-ba24-57045ed6cee5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lazy-loading 'fault' on Instance uuid 48735dde-9de8-4b71-877f-e86789f4c887 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:30:59.846154 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5e085d66-2f54-48d9-ba24-57045ed6cee5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:59.858107 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5e085d66-2f54-48d9-ba24-57045ed6cee5 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 200 len: 1331 microversion: 2.1 time: 0.119787 May 09 04:30:59.859321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 323/660] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:30:59 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:30:59.891215 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-17f5da93-8777-488f-8fdb-4e3b2f04d593 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:59.901572 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-17f5da93-8777-488f-8fdb-4e3b2f04d593 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:59.903099 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-17f5da93-8777-488f-8fdb-4e3b2f04d593 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:30:59.904233 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-17f5da93-8777-488f-8fdb-4e3b2f04d593 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1406 microversion: 2.20 time: 0.198667 May 09 04:30:59.904821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 338/661] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:30:59 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:31:00.875460 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a3222a28-cd55-48bc-b980-df934b46ff5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:00.876384 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a3222a28-cd55-48bc-b980-df934b46ff5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:00.883056 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a3222a28-cd55-48bc-b980-df934b46ff5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:00.883709 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a3222a28-cd55-48bc-b980-df934b46ff5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:00.884700 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a3222a28-cd55-48bc-b980-df934b46ff5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:00.885194 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a3222a28-cd55-48bc-b980-df934b46ff5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:00.901559 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-a3222a28-cd55-48bc-b980-df934b46ff5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] HTTP exception thrown: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a3222a28-cd55-48bc-b980-df934b46ff5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Request method failure captured: May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 HTTP/1.1 May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJhTbCVgTT3HZuxvtZpJ_cLiO-p5aO5ZCrkaJhYtCXNfzo_IXS3499vPTrl-cgrMt-SnaVL5V4wtRTXaaPRZskqvbSNvwlk-mrGJOcozoTU2E5zQ45dYOd-AEzlNKKX4qka08Rdzwq7NFgcZCZDko0TOyv7hyBbf4It5Ltr84wDaqIk May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:31:00.903477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:31:00.905073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:31:00.905073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-AttachVolumeNegativeTest-70527954 May 09 04:31:00.905073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:31:00.905073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:31:00.905073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:31:00.905073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:31:00.905073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:31:00.905073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: c56a403eeee84720ba765e2d4367df74 May 09 04:31:00.905073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:31:00.905073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:31:00.905073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:31:00.905073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '48735dde-9de8-4b71-877f-e86789f4c887'} May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:31:00.905939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:31:00.907416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:00.908794 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a3222a28-cd55-48bc-b980-df934b46ff5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Returning 404 to user: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:31:00.908794 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a3222a28-cd55-48bc-b980-df934b46ff5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 404 len: 111 microversion: 2.1 time: 0.033394 May 09 04:31:00.908794 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 324/662] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:00 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:31:00.913822 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-0c874b10-fac3-4495-a39a-6cae098aca76 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '.version_select at 0x7fbfd44e8310>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:00.922496 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f3c40e49-7a53-4faf-8e58-016fd4d64f61 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:00.923094 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f3c40e49-7a53-4faf-8e58-016fd4d64f61 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:00.929500 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3c40e49-7a53-4faf-8e58-016fd4d64f61 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:00.929975 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3c40e49-7a53-4faf-8e58-016fd4d64f61 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:00.931098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3c40e49-7a53-4faf-8e58-016fd4d64f61 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:00.932315 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3c40e49-7a53-4faf-8e58-016fd4d64f61 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:00.932987 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-0c874b10-fac3-4495-a39a-6cae098aca76 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-585694648" status: 202 len: 0 microversion: 2.1 time: 0.022942 May 09 04:31:00.933574 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 339/663] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 9 04:31:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-585694648 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:31:01.065602 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f3c40e49-7a53-4faf-8e58-016fd4d64f61 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:01.074857 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f3c40e49-7a53-4faf-8e58-016fd4d64f61 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:01.076725 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f3c40e49-7a53-4faf-8e58-016fd4d64f61 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:01.083301 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f3c40e49-7a53-4faf-8e58-016fd4d64f61 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1598 microversion: 2.20 time: 0.159962 May 09 04:31:01.083925 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 325/664] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:31:00 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:31:01.102817 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c2316f6a-366a-451d-9811-d71ab0cf7650 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:01.103443 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c2316f6a-366a-451d-9811-d71ab0cf7650 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:01.109332 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c2316f6a-366a-451d-9811-d71ab0cf7650 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:01.109778 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c2316f6a-366a-451d-9811-d71ab0cf7650 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:01.110546 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c2316f6a-366a-451d-9811-d71ab0cf7650 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:01.110974 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c2316f6a-366a-451d-9811-d71ab0cf7650 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:01.241856 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c2316f6a-366a-451d-9811-d71ab0cf7650 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.142998 May 09 04:31:01.242476 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 340/665] 10.222.0.44 () {60 vars in 1315 bytes} [Mon May 9 04:31:01 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 04:31:01.546069 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9a2145e4-4187-4850-89f5-4993b284d4c6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Action: 'create', calling method: .version_select at 0x7fbfd444bca0>, body: {"keypair": {"name": "tempest-keypair-475203447"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:01.560111 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-9a2145e4-4187-4850-89f5-4993b284d4c6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:31:01.563950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-9a2145e4-4187-4850-89f5-4993b284d4c6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for user c56a403eeee84720ba765e2d4367df74 and project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:31:01.731600 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-9a2145e4-4187-4850-89f5-4993b284d4c6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:31:01.735319 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-9a2145e4-4187-4850-89f5-4993b284d4c6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for user c56a403eeee84720ba765e2d4367df74 and project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:31:01.752492 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9a2145e4-4187-4850-89f5-4993b284d4c6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.210772 May 09 04:31:01.753145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 326/666] 10.222.0.44 () {60 vars in 1157 bytes} [Mon May 9 04:31:01 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:02.261430 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-8c65ad64-cf84-4326-9a15-55c2b22a9cfc req-e87a4777-3cbc-49c2-a36c-a42cfd8475cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96f5900f-cb8a-485d-866b-580b188cc09c", "tag": "374d080b-906f-4857-97aa-846916239632"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:02.269678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-8c65ad64-cf84-4326-9a15-55c2b22a9cfc req-e87a4777-3cbc-49c2-a36c-a42cfd8475cd service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:02.270198 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-8c65ad64-cf84-4326-9a15-55c2b22a9cfc req-e87a4777-3cbc-49c2-a36c-a42cfd8475cd service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:02.281488 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-8c65ad64-cf84-4326-9a15-55c2b22a9cfc req-e87a4777-3cbc-49c2-a36c-a42cfd8475cd service nova] Creating event network-changed:374d080b-906f-4857-97aa-846916239632 for instance 96f5900f-cb8a-485d-866b-580b188cc09c on hv-cinder-83800 May 09 04:31:02.287074 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-8c65ad64-cf84-4326-9a15-55c2b22a9cfc req-e87a4777-3cbc-49c2-a36c-a42cfd8475cd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030335 May 09 04:31:02.287784 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 341/667] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:02.986556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-12406397", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cff1ca97-0d5c-4d7d-b3c2-a81f844b16da"}], "security_groups": [{"name": "tempest-securitygroup--1273880903"}], "key_name": "tempest-keypair-475203447", "user_data": "}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:03.099719 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] validate_networks() for [('cff1ca97-0d5c-4d7d-b3c2-a81f844b16da', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:31:03.500693 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:31:03.501105 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:31:03.501649 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:31:03.502051 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:31:03.502463 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:31:03.513319 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:03.513756 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:03.514539 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:03.515524 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:03.534602 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:31:03.539548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for user c56a403eeee84720ba765e2d4367df74 and project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:31:03.551563 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:31:03.553950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:31:03.601301 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-409b12dc-1312-41d9-926c-348f1dd04c4a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.620664 May 09 04:31:03.602467 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 327/668] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:31:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:31:03.613185 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8c5e179b-2bdb-4c80-8509-0086b3c631a4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:03.613973 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8c5e179b-2bdb-4c80-8509-0086b3c631a4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:03.671992 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8c5e179b-2bdb-4c80-8509-0086b3c631a4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:03.678791 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8c5e179b-2bdb-4c80-8509-0086b3c631a4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1239 microversion: 2.1 time: 0.070274 May 09 04:31:03.679376 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 342/669] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:03 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:04.365151 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-11d5b953-3275-4af7-b078-0ab7022ffd3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:04.366136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-11d5b953-3275-4af7-b078-0ab7022ffd3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:04.373369 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-11d5b953-3275-4af7-b078-0ab7022ffd3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:04.373806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-11d5b953-3275-4af7-b078-0ab7022ffd3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:04.374561 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-11d5b953-3275-4af7-b078-0ab7022ffd3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:04.374991 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-11d5b953-3275-4af7-b078-0ab7022ffd3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:04.402308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-11d5b953-3275-4af7-b078-0ab7022ffd3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041521 May 09 04:31:04.402857 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 328/670] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:31:04 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 04:31:04.458557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6acdd140-7ddd-4a54-ac43-986104fa8de9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:04.459052 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6acdd140-7ddd-4a54-ac43-986104fa8de9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:04.466926 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6acdd140-7ddd-4a54-ac43-986104fa8de9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:04.467375 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6acdd140-7ddd-4a54-ac43-986104fa8de9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:04.468160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6acdd140-7ddd-4a54-ac43-986104fa8de9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:04.468597 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6acdd140-7ddd-4a54-ac43-986104fa8de9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:04.499707 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6acdd140-7ddd-4a54-ac43-986104fa8de9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Going to try to terminate instance {{(pid=117033) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:31:04.577859 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6acdd140-7ddd-4a54-ac43-986104fa8de9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 204 len: 0 microversion: 2.1 time: 0.122613 May 09 04:31:04.578383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 343/671] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:31:04 2022] DELETE /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:31:04.586778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a81ec14b-7ce9-46de-9843-a6878e167263 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:04.588054 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a81ec14b-7ce9-46de-9843-a6878e167263 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:04.594262 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a81ec14b-7ce9-46de-9843-a6878e167263 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:04.594824 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a81ec14b-7ce9-46de-9843-a6878e167263 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:04.595711 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a81ec14b-7ce9-46de-9843-a6878e167263 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:04.596399 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a81ec14b-7ce9-46de-9843-a6878e167263 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:04.698566 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b77d04be-ec06-4696-b059-afcc82bddeab tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:04.699438 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b77d04be-ec06-4696-b059-afcc82bddeab tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:04.706139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b77d04be-ec06-4696-b059-afcc82bddeab tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:04.706595 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b77d04be-ec06-4696-b059-afcc82bddeab tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:04.707413 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b77d04be-ec06-4696-b059-afcc82bddeab tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:04.707854 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b77d04be-ec06-4696-b059-afcc82bddeab tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:04.771991 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a81ec14b-7ce9-46de-9843-a6878e167263 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:04.772192 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b77d04be-ec06-4696-b059-afcc82bddeab tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:04.779584 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b77d04be-ec06-4696-b059-afcc82bddeab tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1309 microversion: 2.1 time: 0.086626 May 09 04:31:04.779762 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a81ec14b-7ce9-46de-9843-a6878e167263 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1674 microversion: 2.1 time: 0.197001 May 09 04:31:04.780186 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 344/672] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:04 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1309 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:04.784152 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 329/673] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:04 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1674 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:05.796432 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4bd99a17-e137-4f13-9792-69309a4e391d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:05.797042 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-4bd99a17-e137-4f13-9792-69309a4e391d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:05.800886 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7663b0d8-5e98-45cb-adde-ff4f2d91496d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:05.801502 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7663b0d8-5e98-45cb-adde-ff4f2d91496d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:05.803457 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4bd99a17-e137-4f13-9792-69309a4e391d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:05.803925 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4bd99a17-e137-4f13-9792-69309a4e391d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:05.804692 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4bd99a17-e137-4f13-9792-69309a4e391d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:05.805120 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4bd99a17-e137-4f13-9792-69309a4e391d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:05.807836 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7663b0d8-5e98-45cb-adde-ff4f2d91496d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:05.808315 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7663b0d8-5e98-45cb-adde-ff4f2d91496d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:05.809080 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7663b0d8-5e98-45cb-adde-ff4f2d91496d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:05.809515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7663b0d8-5e98-45cb-adde-ff4f2d91496d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:05.871050 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4bd99a17-e137-4f13-9792-69309a4e391d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:05.879083 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-4bd99a17-e137-4f13-9792-69309a4e391d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1309 microversion: 2.1 time: 0.086448 May 09 04:31:05.879652 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 345/674] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:05 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1309 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:05.941772 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7663b0d8-5e98-45cb-adde-ff4f2d91496d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:05.949114 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7663b0d8-5e98-45cb-adde-ff4f2d91496d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1674 microversion: 2.1 time: 0.151961 May 09 04:31:05.949680 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 330/675] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:05 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:06.897964 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6c51fe7a-32bf-4a89-aad8-83b3488da6a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:06.898590 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6c51fe7a-32bf-4a89-aad8-83b3488da6a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:06.905519 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6c51fe7a-32bf-4a89-aad8-83b3488da6a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:06.906216 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6c51fe7a-32bf-4a89-aad8-83b3488da6a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:06.907381 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6c51fe7a-32bf-4a89-aad8-83b3488da6a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:06.908000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6c51fe7a-32bf-4a89-aad8-83b3488da6a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:06.966668 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f53b51ce-aaf1-4499-adc1-6af385408b22 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:06.967453 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f53b51ce-aaf1-4499-adc1-6af385408b22 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:06.973908 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f53b51ce-aaf1-4499-adc1-6af385408b22 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:06.974463 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f53b51ce-aaf1-4499-adc1-6af385408b22 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:06.975324 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f53b51ce-aaf1-4499-adc1-6af385408b22 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:06.975862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f53b51ce-aaf1-4499-adc1-6af385408b22 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:06.986728 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-6c51fe7a-32bf-4a89-aad8-83b3488da6a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:07.000274 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6c51fe7a-32bf-4a89-aad8-83b3488da6a7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1297 microversion: 2.1 time: 0.105725 May 09 04:31:07.001142 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 346/676] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:06 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:07.172726 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f53b51ce-aaf1-4499-adc1-6af385408b22 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:07.180158 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f53b51ce-aaf1-4499-adc1-6af385408b22 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1674 microversion: 2.1 time: 0.217639 May 09 04:31:07.180759 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 331/677] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:06 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1674 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:07.954230 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-b5b44625-8741-4ca6-a227-fbe764308415 req-a83546ad-5568-453c-b743-dbf27eaa5317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2923fc2-3ae0-4f89-b36c-193752581504", "name": "network-vif-deleted", "tag": "7cfb4f53-5fec-4952-ba0d-117da0e35d2d"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:07.969422 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-b5b44625-8741-4ca6-a227-fbe764308415 req-a83546ad-5568-453c-b743-dbf27eaa5317 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:07.970120 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-b5b44625-8741-4ca6-a227-fbe764308415 req-a83546ad-5568-453c-b743-dbf27eaa5317 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:07.982980 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-b5b44625-8741-4ca6-a227-fbe764308415 req-a83546ad-5568-453c-b743-dbf27eaa5317 service nova] Creating event network-vif-deleted:7cfb4f53-5fec-4952-ba0d-117da0e35d2d for instance f2923fc2-3ae0-4f89-b36c-193752581504 on hv-cinder-83800 May 09 04:31:07.988613 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-b5b44625-8741-4ca6-a227-fbe764308415 req-a83546ad-5568-453c-b743-dbf27eaa5317 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037905 May 09 04:31:07.989693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 347/678] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:08.018991 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1f4d8548-4f7f-44bb-bd5c-b323b4f37242 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:08.020541 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1f4d8548-4f7f-44bb-bd5c-b323b4f37242 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:08.030058 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1f4d8548-4f7f-44bb-bd5c-b323b4f37242 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:08.030850 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1f4d8548-4f7f-44bb-bd5c-b323b4f37242 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:08.031813 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1f4d8548-4f7f-44bb-bd5c-b323b4f37242 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:08.032457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1f4d8548-4f7f-44bb-bd5c-b323b4f37242 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:08.123316 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-a44b9d2a-731c-4629-964b-37ded67743bf req-ea34baf6-c87f-414f-8782-485f8c342f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8206836d-7fa2-48b8-8d4c-46c70608a3e0", "tag": "bdb24e55-7862-4ad0-a43d-7830e3139255"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:08.132731 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-a44b9d2a-731c-4629-964b-37ded67743bf req-ea34baf6-c87f-414f-8782-485f8c342f9c service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:08.133929 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-a44b9d2a-731c-4629-964b-37ded67743bf req-ea34baf6-c87f-414f-8782-485f8c342f9c service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:08.148190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-a44b9d2a-731c-4629-964b-37ded67743bf req-ea34baf6-c87f-414f-8782-485f8c342f9c service nova] Creating event network-changed:bdb24e55-7862-4ad0-a43d-7830e3139255 for instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 on hv-cinder-83800 May 09 04:31:08.155864 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-a44b9d2a-731c-4629-964b-37ded67743bf req-ea34baf6-c87f-414f-8782-485f8c342f9c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037995 May 09 04:31:08.157611 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 348/679] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:08.201324 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-00840fb4-0d23-4e72-b3e0-42dd49dea8e2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:08.202742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-00840fb4-0d23-4e72-b3e0-42dd49dea8e2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:08.212392 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-00840fb4-0d23-4e72-b3e0-42dd49dea8e2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:08.213497 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-00840fb4-0d23-4e72-b3e0-42dd49dea8e2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:08.214464 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-00840fb4-0d23-4e72-b3e0-42dd49dea8e2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:08.215061 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-00840fb4-0d23-4e72-b3e0-42dd49dea8e2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:08.240264 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1f4d8548-4f7f-44bb-bd5c-b323b4f37242 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:08.248977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1f4d8548-4f7f-44bb-bd5c-b323b4f37242 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1365 microversion: 2.1 time: 0.234664 May 09 04:31:08.249568 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 332/680] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:08 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:08.253538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-00840fb4-0d23-4e72-b3e0-42dd49dea8e2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:08.254259 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-00840fb4-0d23-4e72-b3e0-42dd49dea8e2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:08.254800 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.objects.instance [None req-00840fb4-0d23-4e72-b3e0-42dd49dea8e2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lazy-loading 'fault' on Instance uuid f2923fc2-3ae0-4f89-b36c-193752581504 {{(pid=117033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:31:08.302089 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-00840fb4-0d23-4e72-b3e0-42dd49dea8e2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:08.310365 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-00840fb4-0d23-4e72-b3e0-42dd49dea8e2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 200 len: 1326 microversion: 2.1 time: 0.115782 May 09 04:31:08.311103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 349/681] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:08 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 1326 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:09.265637 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-04b8a9bc-787d-478b-b117-ab5099527e3c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:09.266244 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-04b8a9bc-787d-478b-b117-ab5099527e3c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:09.272579 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04b8a9bc-787d-478b-b117-ab5099527e3c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:09.273022 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04b8a9bc-787d-478b-b117-ab5099527e3c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:09.273772 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04b8a9bc-787d-478b-b117-ab5099527e3c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:09.274752 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04b8a9bc-787d-478b-b117-ab5099527e3c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:09.328036 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-768678b7-1bcd-4a9c-8853-e5d11215142c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:09.328653 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-768678b7-1bcd-4a9c-8853-e5d11215142c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:09.335027 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-768678b7-1bcd-4a9c-8853-e5d11215142c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:09.335477 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-768678b7-1bcd-4a9c-8853-e5d11215142c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:09.336269 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-768678b7-1bcd-4a9c-8853-e5d11215142c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:09.337565 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-768678b7-1bcd-4a9c-8853-e5d11215142c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:09.351004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-768678b7-1bcd-4a9c-8853-e5d11215142c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] HTTP exception thrown: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-768678b7-1bcd-4a9c-8853-e5d11215142c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Request method failure captured: May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 HTTP/1.1 May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJfsOwB-_DgX5ZO9256k2I3UlwLV6InbIE55-tlgUJ6EclsTlhsb31ecA6VrELMtC8lDMItruSO-h_e4ze-GkoQBurc-EMbECIHJY1WryYqZrA50jzy7ATDaUxxjq0BMjfbmk6FJOkPQ74YWNhSnmz1MTCXT6bVM3CUwAkfffWtcwYM May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 3c23c235fa1c4944bd7a337357d0c030 May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-AttachVolumeTestJSON-1840327184 May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:31:09.352693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:31:09.354168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:31:09.354168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-AttachVolumeTestJSON-1840327184 May 09 04:31:09.354168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 3c23c235fa1c4944bd7a337357d0c030 May 09 04:31:09.354168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1840327184 May 09 04:31:09.354168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-AttachVolumeTestJSON-1840327184-project May 09 04:31:09.354168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:31:09.354168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:31:09.354168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 85429c28c994443eb30b98ece56c4c9b May 09 04:31:09.354168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-AttachVolumeTestJSON-1840327184-project May 09 04:31:09.354168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:31:09.354168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:31:09.354168 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': 'f2923fc2-3ae0-4f89-b36c-193752581504'} May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:31:09.355666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:31:09.357090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:31:09.358349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-768678b7-1bcd-4a9c-8853-e5d11215142c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Returning 404 to user: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:31:09.358349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-768678b7-1bcd-4a9c-8853-e5d11215142c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 404 len: 111 microversion: 2.1 time: 0.030011 May 09 04:31:09.358349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 350/682] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:09 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 04:31:09.362459 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ba8df52d-d2f5-49fa-927c-ff20a5ff51b2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '.version_select at 0x7fbfd45b6d30>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:09.379775 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ba8df52d-d2f5-49fa-927c-ff20a5ff51b2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-872048384" status: 202 len: 0 microversion: 2.1 time: 0.020776 May 09 04:31:09.380563 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 351/683] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 9 04:31:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-872048384 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:31:09.406978 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-04b8a9bc-787d-478b-b117-ab5099527e3c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:09.414288 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-04b8a9bc-787d-478b-b117-ab5099527e3c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1365 microversion: 2.1 time: 0.152465 May 09 04:31:09.414942 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 333/684] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:09 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:10.100232 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3bfd9471-5070-4f05-85fa-c79ec96099d7 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Action: 'create', calling method: .version_select at 0x7fbfd45258b0>, body: {"keypair": {"name": "tempest-keypair-823453614"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:10.114745 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-3bfd9471-5070-4f05-85fa-c79ec96099d7 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Getting quotas for project 3c23c235fa1c4944bd7a337357d0c030. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:31:10.119570 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-3bfd9471-5070-4f05-85fa-c79ec96099d7 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Getting quotas for user 85429c28c994443eb30b98ece56c4c9b and project 3c23c235fa1c4944bd7a337357d0c030. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:31:10.247366 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-3bfd9471-5070-4f05-85fa-c79ec96099d7 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Getting quotas for project 3c23c235fa1c4944bd7a337357d0c030. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:31:10.251036 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-3bfd9471-5070-4f05-85fa-c79ec96099d7 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Getting quotas for user 85429c28c994443eb30b98ece56c4c9b and project 3c23c235fa1c4944bd7a337357d0c030. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:31:10.264994 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-3bfd9471-5070-4f05-85fa-c79ec96099d7 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.168655 May 09 04:31:10.265594 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 352/685] 10.222.0.44 () {60 vars in 1157 bytes} [Mon May 9 04:31:10 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:10.431359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9d24a482-15ad-47e3-8045-5cbc01580233 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:10.432009 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9d24a482-15ad-47e3-8045-5cbc01580233 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:10.438355 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9d24a482-15ad-47e3-8045-5cbc01580233 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:10.438931 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9d24a482-15ad-47e3-8045-5cbc01580233 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:10.439701 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9d24a482-15ad-47e3-8045-5cbc01580233 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:10.440152 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9d24a482-15ad-47e3-8045-5cbc01580233 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:10.573180 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9d24a482-15ad-47e3-8045-5cbc01580233 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:10.580828 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9d24a482-15ad-47e3-8045-5cbc01580233 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1365 microversion: 2.1 time: 0.154161 May 09 04:31:10.581406 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 334/686] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:10 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:11.437760 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1622456251", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97444843-38bb-4cb5-93cc-2ce85c9e2986"}], "security_groups": [{"name": "tempest-securitygroup--59367190"}], "key_name": "tempest-keypair-823453614", "user_data": "}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:11.538505 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.network.neutron [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] validate_networks() for [('97444843-38bb-4cb5-93cc-2ce85c9e2986', None, None, None, None, None)] {{(pid=117033) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:31:11.597985 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e683bce3-d6e7-41ce-84f8-ecf9bb71b73d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:11.598519 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e683bce3-d6e7-41ce-84f8-ecf9bb71b73d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:11.605057 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e683bce3-d6e7-41ce-84f8-ecf9bb71b73d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:11.605501 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e683bce3-d6e7-41ce-84f8-ecf9bb71b73d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:11.606291 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e683bce3-d6e7-41ce-84f8-ecf9bb71b73d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:11.606722 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e683bce3-d6e7-41ce-84f8-ecf9bb71b73d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:11.738957 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e683bce3-d6e7-41ce-84f8-ecf9bb71b73d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:11.747068 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e683bce3-d6e7-41ce-84f8-ecf9bb71b73d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1365 microversion: 2.1 time: 0.152946 May 09 04:31:11.747656 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 335/687] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:11 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:11.897747 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Flavor limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:31:11.898172 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Image limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:31:11.898687 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Flavor pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:31:11.899125 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Image pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:31:11.899536 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:31:11.908154 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:11.908596 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:11.909396 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:11.909826 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:11.927262 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Getting quotas for project 3c23c235fa1c4944bd7a337357d0c030. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:31:11.932151 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Getting quotas for user 85429c28c994443eb30b98ece56c4c9b and project 3c23c235fa1c4944bd7a337357d0c030. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:31:11.943070 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Going to run 1 instances... {{(pid=117033) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:31:11.945360 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:31:11.991770 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-629453ab-1d5f-40e2-8869-0650b54c4488 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.558722 May 09 04:31:11.992453 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 353/688] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:31:11 2022] POST /compute/v2.1/servers => generated 400 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:31:12.002270 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ee5b9368-8cdc-4488-84e4-25ec86b93ecd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:12.002881 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ee5b9368-8cdc-4488-84e4-25ec86b93ecd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:12.055589 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ee5b9368-8cdc-4488-84e4-25ec86b93ecd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:12.062903 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ee5b9368-8cdc-4488-84e4-25ec86b93ecd tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1237 microversion: 2.1 time: 0.064357 May 09 04:31:12.063512 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 336/689] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:11 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:12.764831 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e9eabd9e-4cdf-40a0-994a-f41f5f745388 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:12.765441 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e9eabd9e-4cdf-40a0-994a-f41f5f745388 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:12.771417 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e9eabd9e-4cdf-40a0-994a-f41f5f745388 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:12.771907 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e9eabd9e-4cdf-40a0-994a-f41f5f745388 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:12.772671 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e9eabd9e-4cdf-40a0-994a-f41f5f745388 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:12.773100 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e9eabd9e-4cdf-40a0-994a-f41f5f745388 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:12.904488 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e9eabd9e-4cdf-40a0-994a-f41f5f745388 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:12.911867 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e9eabd9e-4cdf-40a0-994a-f41f5f745388 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1365 microversion: 2.1 time: 0.151347 May 09 04:31:12.912540 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 354/690] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:12 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:13.083109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b424f436-e291-4863-bd5f-1893fad7d424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:13.084328 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b424f436-e291-4863-bd5f-1893fad7d424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:13.095268 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b424f436-e291-4863-bd5f-1893fad7d424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:13.096118 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b424f436-e291-4863-bd5f-1893fad7d424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:13.097947 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b424f436-e291-4863-bd5f-1893fad7d424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:13.098810 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b424f436-e291-4863-bd5f-1893fad7d424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:13.176437 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b424f436-e291-4863-bd5f-1893fad7d424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:13.184255 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b424f436-e291-4863-bd5f-1893fad7d424 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1295 microversion: 2.1 time: 0.108086 May 09 04:31:13.184820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 337/691] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:13 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1295 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:13.932656 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1a7b55f3-c440-4397-9e64-b173e83e161f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:13.933351 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1a7b55f3-c440-4397-9e64-b173e83e161f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:13.939875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a7b55f3-c440-4397-9e64-b173e83e161f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:13.940427 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a7b55f3-c440-4397-9e64-b173e83e161f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:13.941267 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a7b55f3-c440-4397-9e64-b173e83e161f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:13.941770 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a7b55f3-c440-4397-9e64-b173e83e161f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:14.072982 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1a7b55f3-c440-4397-9e64-b173e83e161f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:14.080324 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1a7b55f3-c440-4397-9e64-b173e83e161f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1365 microversion: 2.1 time: 0.154641 May 09 04:31:14.080894 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 355/692] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:13 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:14.201617 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c1b0d8ea-efe5-439e-9acd-aef8ba718442 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:14.202271 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c1b0d8ea-efe5-439e-9acd-aef8ba718442 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:14.219663 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c1b0d8ea-efe5-439e-9acd-aef8ba718442 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:14.220364 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c1b0d8ea-efe5-439e-9acd-aef8ba718442 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:14.221830 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c1b0d8ea-efe5-439e-9acd-aef8ba718442 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:14.222539 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c1b0d8ea-efe5-439e-9acd-aef8ba718442 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:14.264920 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-607202cf-0b14-4571-9f62-42d2af399abe req-da07216a-869e-447e-a109-e96f7c8b61f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8206836d-7fa2-48b8-8d4c-46c70608a3e0", "name": "network-vif-plugged", "status": "completed", "tag": "bdb24e55-7862-4ad0-a43d-7830e3139255"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:14.274308 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-607202cf-0b14-4571-9f62-42d2af399abe req-da07216a-869e-447e-a109-e96f7c8b61f1 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:14.275047 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-607202cf-0b14-4571-9f62-42d2af399abe req-da07216a-869e-447e-a109-e96f7c8b61f1 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:14.291069 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-607202cf-0b14-4571-9f62-42d2af399abe req-da07216a-869e-447e-a109-e96f7c8b61f1 service nova] Creating event network-vif-plugged:bdb24e55-7862-4ad0-a43d-7830e3139255 for instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 on hv-cinder-83800 May 09 04:31:14.296811 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-607202cf-0b14-4571-9f62-42d2af399abe req-da07216a-869e-447e-a109-e96f7c8b61f1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035574 May 09 04:31:14.297767 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 356/693] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:14.456651 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c1b0d8ea-efe5-439e-9acd-aef8ba718442 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:14.465283 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c1b0d8ea-efe5-439e-9acd-aef8ba718442 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1361 microversion: 2.1 time: 0.267731 May 09 04:31:14.466172 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 338/694] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:14 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:14.522740 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-106c94ab-47a0-42e8-93be-5454ffd8bef2 req-f12a1a3c-b364-40cd-8f3a-b53ee8e52fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576d0314-ed60-4d48-83ec-86645233803c", "tag": "e30725aa-831c-4789-9157-939a4a0d3bea"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:14.537157 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-106c94ab-47a0-42e8-93be-5454ffd8bef2 req-f12a1a3c-b364-40cd-8f3a-b53ee8e52fbf service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:14.538477 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-106c94ab-47a0-42e8-93be-5454ffd8bef2 req-f12a1a3c-b364-40cd-8f3a-b53ee8e52fbf service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:14.560556 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-106c94ab-47a0-42e8-93be-5454ffd8bef2 req-f12a1a3c-b364-40cd-8f3a-b53ee8e52fbf service nova] Creating event network-changed:e30725aa-831c-4789-9157-939a4a0d3bea for instance 576d0314-ed60-4d48-83ec-86645233803c on hv-cinder-83800 May 09 04:31:14.566584 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-106c94ab-47a0-42e8-93be-5454ffd8bef2 req-f12a1a3c-b364-40cd-8f3a-b53ee8e52fbf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047498 May 09 04:31:14.567371 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 357/695] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:15.097699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-63ce1b7a-86c5-430d-b16c-4793206d10f3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:15.098305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-63ce1b7a-86c5-430d-b16c-4793206d10f3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:15.104241 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-63ce1b7a-86c5-430d-b16c-4793206d10f3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:15.104683 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-63ce1b7a-86c5-430d-b16c-4793206d10f3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:15.105437 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-63ce1b7a-86c5-430d-b16c-4793206d10f3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:15.105861 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-63ce1b7a-86c5-430d-b16c-4793206d10f3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:15.279334 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-63ce1b7a-86c5-430d-b16c-4793206d10f3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:15.286515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-63ce1b7a-86c5-430d-b16c-4793206d10f3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1365 microversion: 2.1 time: 0.192631 May 09 04:31:15.287077 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 339/696] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:15 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:15.483952 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8d8f4fb7-d2a1-492a-ac97-2d85661820d5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:15.484781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8d8f4fb7-d2a1-492a-ac97-2d85661820d5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:15.491045 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8d8f4fb7-d2a1-492a-ac97-2d85661820d5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:15.491493 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8d8f4fb7-d2a1-492a-ac97-2d85661820d5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:15.492313 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8d8f4fb7-d2a1-492a-ac97-2d85661820d5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:15.493596 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8d8f4fb7-d2a1-492a-ac97-2d85661820d5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:15.680817 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8d8f4fb7-d2a1-492a-ac97-2d85661820d5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:15.688080 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8d8f4fb7-d2a1-492a-ac97-2d85661820d5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1361 microversion: 2.1 time: 0.208776 May 09 04:31:15.688647 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 358/697] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:15 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:16.302894 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2d8a17b4-9cd5-4b71-90da-9f757ed6fc06 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:16.303498 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2d8a17b4-9cd5-4b71-90da-9f757ed6fc06 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:16.309935 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d8a17b4-9cd5-4b71-90da-9f757ed6fc06 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:16.310374 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d8a17b4-9cd5-4b71-90da-9f757ed6fc06 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:16.311127 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d8a17b4-9cd5-4b71-90da-9f757ed6fc06 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:16.311553 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d8a17b4-9cd5-4b71-90da-9f757ed6fc06 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:16.438085 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2d8a17b4-9cd5-4b71-90da-9f757ed6fc06 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:16.445291 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2d8a17b4-9cd5-4b71-90da-9f757ed6fc06 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1365 microversion: 2.1 time: 0.146214 May 09 04:31:16.446467 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 340/698] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:16 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:16.705055 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-cc32a0ed-973a-471d-bc99-cb07fe55846b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:16.705614 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-cc32a0ed-973a-471d-bc99-cb07fe55846b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:16.712236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cc32a0ed-973a-471d-bc99-cb07fe55846b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:16.712687 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cc32a0ed-973a-471d-bc99-cb07fe55846b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:16.713727 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cc32a0ed-973a-471d-bc99-cb07fe55846b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:16.714169 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cc32a0ed-973a-471d-bc99-cb07fe55846b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:16.879775 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-cc32a0ed-973a-471d-bc99-cb07fe55846b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:16.888284 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-cc32a0ed-973a-471d-bc99-cb07fe55846b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1361 microversion: 2.1 time: 0.187187 May 09 04:31:16.888856 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 359/699] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:16 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:17.462698 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dd477287-dbcd-420a-a41d-45a97dbfb74a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:17.463577 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dd477287-dbcd-420a-a41d-45a97dbfb74a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:17.470067 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dd477287-dbcd-420a-a41d-45a97dbfb74a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:17.470509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dd477287-dbcd-420a-a41d-45a97dbfb74a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:17.471282 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dd477287-dbcd-420a-a41d-45a97dbfb74a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:17.471739 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dd477287-dbcd-420a-a41d-45a97dbfb74a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:17.824682 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dd477287-dbcd-420a-a41d-45a97dbfb74a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:17.832238 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dd477287-dbcd-420a-a41d-45a97dbfb74a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1555 microversion: 2.1 time: 0.373401 May 09 04:31:17.833080 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 341/700] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:17 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1555 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:17.849779 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8e2f7c45-54af-4f3c-b2ea-d66f05b8a1aa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:17.850327 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8e2f7c45-54af-4f3c-b2ea-d66f05b8a1aa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:17.857773 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8e2f7c45-54af-4f3c-b2ea-d66f05b8a1aa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:17.858326 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8e2f7c45-54af-4f3c-b2ea-d66f05b8a1aa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:17.859217 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8e2f7c45-54af-4f3c-b2ea-d66f05b8a1aa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:17.859732 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8e2f7c45-54af-4f3c-b2ea-d66f05b8a1aa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:17.905495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-666b1057-68be-4354-a639-459a822f602b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:17.906220 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-666b1057-68be-4354-a639-459a822f602b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:17.912438 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-666b1057-68be-4354-a639-459a822f602b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:17.912957 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-666b1057-68be-4354-a639-459a822f602b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:17.913815 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-666b1057-68be-4354-a639-459a822f602b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:17.914870 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-666b1057-68be-4354-a639-459a822f602b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:17.973864 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8e2f7c45-54af-4f3c-b2ea-d66f05b8a1aa tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127986 May 09 04:31:17.974542 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 360/701] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 04:31:17 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:18.079332 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-666b1057-68be-4354-a639-459a822f602b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:18.087072 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-666b1057-68be-4354-a639-459a822f602b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1361 microversion: 2.1 time: 0.185642 May 09 04:31:18.087687 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 342/702] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:17 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:19.008940 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-d7dd6c11-f5d2-4106-ad01-1cd94689fe58 req-cb3fc4bf-2318-43d4-95a4-8fcec9d3d4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8206836d-7fa2-48b8-8d4c-46c70608a3e0", "tag": "bdb24e55-7862-4ad0-a43d-7830e3139255"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:19.016905 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-d7dd6c11-f5d2-4106-ad01-1cd94689fe58 req-cb3fc4bf-2318-43d4-95a4-8fcec9d3d4cd service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:19.017343 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-d7dd6c11-f5d2-4106-ad01-1cd94689fe58 req-cb3fc4bf-2318-43d4-95a4-8fcec9d3d4cd service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:19.028151 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-d7dd6c11-f5d2-4106-ad01-1cd94689fe58 req-cb3fc4bf-2318-43d4-95a4-8fcec9d3d4cd service nova] Creating event network-changed:bdb24e55-7862-4ad0-a43d-7830e3139255 for instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 on hv-cinder-83800 May 09 04:31:19.033052 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-d7dd6c11-f5d2-4106-ad01-1cd94689fe58 req-cb3fc4bf-2318-43d4-95a4-8fcec9d3d4cd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028886 May 09 04:31:19.033847 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 361/703] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:19.104362 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5b273fd7-bf5e-4fac-9ff8-539eadb55759 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:19.105729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5b273fd7-bf5e-4fac-9ff8-539eadb55759 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:19.112220 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b273fd7-bf5e-4fac-9ff8-539eadb55759 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:19.112607 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b273fd7-bf5e-4fac-9ff8-539eadb55759 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:19.113556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b273fd7-bf5e-4fac-9ff8-539eadb55759 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:19.114156 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b273fd7-bf5e-4fac-9ff8-539eadb55759 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:19.250110 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5b273fd7-bf5e-4fac-9ff8-539eadb55759 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:19.257274 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5b273fd7-bf5e-4fac-9ff8-539eadb55759 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1361 microversion: 2.1 time: 0.157369 May 09 04:31:19.257847 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 343/704] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:19 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:20.275585 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-245b4ca1-504c-44c5-8532-7947607c4af3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:20.276309 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-245b4ca1-504c-44c5-8532-7947607c4af3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:20.282413 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-245b4ca1-504c-44c5-8532-7947607c4af3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:20.282862 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-245b4ca1-504c-44c5-8532-7947607c4af3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:20.283623 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-245b4ca1-504c-44c5-8532-7947607c4af3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:20.284296 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-245b4ca1-504c-44c5-8532-7947607c4af3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:20.418576 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-245b4ca1-504c-44c5-8532-7947607c4af3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:20.426697 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-245b4ca1-504c-44c5-8532-7947607c4af3 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1361 microversion: 2.1 time: 0.155691 May 09 04:31:20.427534 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 362/705] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:20 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:20.640266 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f38ed95a-e56a-41ea-aae9-31a9f2c23af9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:20.640851 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f38ed95a-e56a-41ea-aae9-31a9f2c23af9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:20.646848 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f38ed95a-e56a-41ea-aae9-31a9f2c23af9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:20.647298 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f38ed95a-e56a-41ea-aae9-31a9f2c23af9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:20.648090 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f38ed95a-e56a-41ea-aae9-31a9f2c23af9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:20.648527 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f38ed95a-e56a-41ea-aae9-31a9f2c23af9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:20.671381 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-f38ed95a-e56a-41ea-aae9-31a9f2c23af9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lazy-loading 'flavor' on Instance uuid a541a008-c541-407b-8868-a2b9d98ed15d {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:31:20.746227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f38ed95a-e56a-41ea-aae9-31a9f2c23af9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "POST /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d/action" status: 202 len: 0 microversion: 2.1 time: 0.109691 May 09 04:31:20.750149 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 344/706] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 04:31:20 2022] POST /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:31:20.760644 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c3702fe8-db9f-45a4-8f1a-d77aa6876dea tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:20.761390 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c3702fe8-db9f-45a4-8f1a-d77aa6876dea tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:20.767853 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c3702fe8-db9f-45a4-8f1a-d77aa6876dea tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:20.768796 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c3702fe8-db9f-45a4-8f1a-d77aa6876dea tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:20.769598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c3702fe8-db9f-45a4-8f1a-d77aa6876dea tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:20.770070 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c3702fe8-db9f-45a4-8f1a-d77aa6876dea tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:20.900767 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c3702fe8-db9f-45a4-8f1a-d77aa6876dea tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:20.908209 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c3702fe8-db9f-45a4-8f1a-d77aa6876dea tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1568 microversion: 2.1 time: 0.156843 May 09 04:31:20.908781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 363/707] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:20 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:21.496931 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3a900225-d57c-4d96-8929-0dab171d6be8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:21.497653 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3a900225-d57c-4d96-8929-0dab171d6be8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:21.503608 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a900225-d57c-4d96-8929-0dab171d6be8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:21.504090 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a900225-d57c-4d96-8929-0dab171d6be8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:21.504840 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a900225-d57c-4d96-8929-0dab171d6be8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:21.505268 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a900225-d57c-4d96-8929-0dab171d6be8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:21.634964 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3a900225-d57c-4d96-8929-0dab171d6be8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:21.642145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3a900225-d57c-4d96-8929-0dab171d6be8 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1361 microversion: 2.1 time: 0.201607 May 09 04:31:21.642697 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 345/708] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:21 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:21.925653 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5713bb7a-dc2d-47e3-a2c8-b69627e3cc43 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:21.926177 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5713bb7a-dc2d-47e3-a2c8-b69627e3cc43 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:21.932837 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5713bb7a-dc2d-47e3-a2c8-b69627e3cc43 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:21.933320 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5713bb7a-dc2d-47e3-a2c8-b69627e3cc43 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:21.934096 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5713bb7a-dc2d-47e3-a2c8-b69627e3cc43 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:21.934539 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5713bb7a-dc2d-47e3-a2c8-b69627e3cc43 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:22.062809 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5713bb7a-dc2d-47e3-a2c8-b69627e3cc43 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:22.070120 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5713bb7a-dc2d-47e3-a2c8-b69627e3cc43 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1568 microversion: 2.1 time: 0.148394 May 09 04:31:22.071290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 364/709] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:21 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:22.297421 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-ed09f6bf-ea78-45b8-838a-0dd563f0d06c req-b8134c47-4ce0-4bfb-b488-6550deeb0683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "576d0314-ed60-4d48-83ec-86645233803c", "name": "network-vif-plugged", "status": "completed", "tag": "e30725aa-831c-4789-9157-939a4a0d3bea"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:22.306606 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-ed09f6bf-ea78-45b8-838a-0dd563f0d06c req-b8134c47-4ce0-4bfb-b488-6550deeb0683 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:22.307068 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-ed09f6bf-ea78-45b8-838a-0dd563f0d06c req-b8134c47-4ce0-4bfb-b488-6550deeb0683 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:22.318212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-ed09f6bf-ea78-45b8-838a-0dd563f0d06c req-b8134c47-4ce0-4bfb-b488-6550deeb0683 service nova] Creating event network-vif-plugged:e30725aa-831c-4789-9157-939a4a0d3bea for instance 576d0314-ed60-4d48-83ec-86645233803c on hv-cinder-83800 May 09 04:31:22.323706 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-ed09f6bf-ea78-45b8-838a-0dd563f0d06c req-b8134c47-4ce0-4bfb-b488-6550deeb0683 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030005 May 09 04:31:22.324339 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 346/710] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:22.658589 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e324f517-1ccb-4650-b37e-6bc5ff84fd1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:22.659205 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e324f517-1ccb-4650-b37e-6bc5ff84fd1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:22.665259 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e324f517-1ccb-4650-b37e-6bc5ff84fd1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:22.665711 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e324f517-1ccb-4650-b37e-6bc5ff84fd1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:22.666502 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e324f517-1ccb-4650-b37e-6bc5ff84fd1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:22.666967 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e324f517-1ccb-4650-b37e-6bc5ff84fd1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:22.794009 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e324f517-1ccb-4650-b37e-6bc5ff84fd1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:22.801373 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e324f517-1ccb-4650-b37e-6bc5ff84fd1d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1361 microversion: 2.1 time: 0.146662 May 09 04:31:22.801954 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 365/711] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:22 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:23.088465 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-114a3f1b-b700-4beb-9056-0125a7e79cae tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:23.089088 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-114a3f1b-b700-4beb-9056-0125a7e79cae tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:23.095283 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-114a3f1b-b700-4beb-9056-0125a7e79cae tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:23.095726 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-114a3f1b-b700-4beb-9056-0125a7e79cae tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:23.096510 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-114a3f1b-b700-4beb-9056-0125a7e79cae tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:23.096942 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-114a3f1b-b700-4beb-9056-0125a7e79cae tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:23.228062 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-114a3f1b-b700-4beb-9056-0125a7e79cae tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:23.235330 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-114a3f1b-b700-4beb-9056-0125a7e79cae tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1568 microversion: 2.1 time: 0.151489 May 09 04:31:23.235916 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 347/712] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:23 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:23.818471 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b434565f-3fc2-46fc-b85c-c17b6ef0ad09 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:23.819075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b434565f-3fc2-46fc-b85c-c17b6ef0ad09 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:23.825694 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b434565f-3fc2-46fc-b85c-c17b6ef0ad09 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:23.826139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b434565f-3fc2-46fc-b85c-c17b6ef0ad09 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:23.826896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b434565f-3fc2-46fc-b85c-c17b6ef0ad09 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:23.827330 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b434565f-3fc2-46fc-b85c-c17b6ef0ad09 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:23.957430 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b434565f-3fc2-46fc-b85c-c17b6ef0ad09 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:23.965110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b434565f-3fc2-46fc-b85c-c17b6ef0ad09 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1361 microversion: 2.1 time: 0.150445 May 09 04:31:23.965674 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 366/713] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:23 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:24.251577 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-73ad8b35-3a2b-4651-8de6-2a8157707a24 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:24.252208 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-73ad8b35-3a2b-4651-8de6-2a8157707a24 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:24.259167 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73ad8b35-3a2b-4651-8de6-2a8157707a24 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:24.259608 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73ad8b35-3a2b-4651-8de6-2a8157707a24 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:24.260395 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73ad8b35-3a2b-4651-8de6-2a8157707a24 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:24.260849 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73ad8b35-3a2b-4651-8de6-2a8157707a24 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:24.393962 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-73ad8b35-3a2b-4651-8de6-2a8157707a24 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:24.401600 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-73ad8b35-3a2b-4651-8de6-2a8157707a24 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1568 microversion: 2.1 time: 0.153882 May 09 04:31:24.402101 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 348/714] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:24 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:24.982556 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c7cf7db1-6f63-49f2-a542-32ebd1814622 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:24.983160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c7cf7db1-6f63-49f2-a542-32ebd1814622 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:24.989606 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c7cf7db1-6f63-49f2-a542-32ebd1814622 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:24.990051 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c7cf7db1-6f63-49f2-a542-32ebd1814622 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:24.990803 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c7cf7db1-6f63-49f2-a542-32ebd1814622 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:24.991232 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c7cf7db1-6f63-49f2-a542-32ebd1814622 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:25.116599 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c7cf7db1-6f63-49f2-a542-32ebd1814622 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:25.123762 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c7cf7db1-6f63-49f2-a542-32ebd1814622 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1548 microversion: 2.1 time: 0.145070 May 09 04:31:25.124372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 367/715] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:24 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:25.140107 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9075df02-8c68-4191-9b7f-441f2bb7bb74 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:25.140599 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9075df02-8c68-4191-9b7f-441f2bb7bb74 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:25.146546 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9075df02-8c68-4191-9b7f-441f2bb7bb74 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:25.146994 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9075df02-8c68-4191-9b7f-441f2bb7bb74 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:25.147749 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9075df02-8c68-4191-9b7f-441f2bb7bb74 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:25.148222 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9075df02-8c68-4191-9b7f-441f2bb7bb74 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:25.224256 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9075df02-8c68-4191-9b7f-441f2bb7bb74 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087899 May 09 04:31:25.224853 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 349/716] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 04:31:25 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:25.418577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f137b332-da3e-401d-95ee-d2b7ceb24150 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:25.419195 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f137b332-da3e-401d-95ee-d2b7ceb24150 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:25.425521 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f137b332-da3e-401d-95ee-d2b7ceb24150 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:25.425979 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f137b332-da3e-401d-95ee-d2b7ceb24150 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:25.426787 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f137b332-da3e-401d-95ee-d2b7ceb24150 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:25.427224 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f137b332-da3e-401d-95ee-d2b7ceb24150 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:25.557047 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f137b332-da3e-401d-95ee-d2b7ceb24150 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:25.564508 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f137b332-da3e-401d-95ee-d2b7ceb24150 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1568 microversion: 2.1 time: 0.149980 May 09 04:31:25.565088 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 368/717] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:25 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:26.193183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-d9189587-2dbc-4e29-83fe-55971672c851 req-c584b099-762d-4d54-b915-10dc2f070abc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576d0314-ed60-4d48-83ec-86645233803c", "tag": "e30725aa-831c-4789-9157-939a4a0d3bea"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:26.201843 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-d9189587-2dbc-4e29-83fe-55971672c851 req-c584b099-762d-4d54-b915-10dc2f070abc service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:26.202280 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-d9189587-2dbc-4e29-83fe-55971672c851 req-c584b099-762d-4d54-b915-10dc2f070abc service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:26.214050 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-d9189587-2dbc-4e29-83fe-55971672c851 req-c584b099-762d-4d54-b915-10dc2f070abc service nova] Creating event network-changed:e30725aa-831c-4789-9157-939a4a0d3bea for instance 576d0314-ed60-4d48-83ec-86645233803c on hv-cinder-83800 May 09 04:31:26.218892 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-d9189587-2dbc-4e29-83fe-55971672c851 req-c584b099-762d-4d54-b915-10dc2f070abc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029393 May 09 04:31:26.219827 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 350/718] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:26.582333 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-93f9562d-aac9-4770-b6d8-8b5c84433a09 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:26.582939 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-93f9562d-aac9-4770-b6d8-8b5c84433a09 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:26.589534 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-93f9562d-aac9-4770-b6d8-8b5c84433a09 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:26.590217 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-93f9562d-aac9-4770-b6d8-8b5c84433a09 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:26.591188 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-93f9562d-aac9-4770-b6d8-8b5c84433a09 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:26.591803 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-93f9562d-aac9-4770-b6d8-8b5c84433a09 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:27.025888 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-93f9562d-aac9-4770-b6d8-8b5c84433a09 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:27.033368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-93f9562d-aac9-4770-b6d8-8b5c84433a09 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1568 microversion: 2.1 time: 0.454793 May 09 04:31:27.033942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 369/719] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:26 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1568 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:28.051846 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-14b2e61f-45a6-434e-887a-be1c7ced7700 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:28.052526 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-14b2e61f-45a6-434e-887a-be1c7ced7700 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:28.059374 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-14b2e61f-45a6-434e-887a-be1c7ced7700 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:28.059818 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-14b2e61f-45a6-434e-887a-be1c7ced7700 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:28.060616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-14b2e61f-45a6-434e-887a-be1c7ced7700 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:28.061049 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-14b2e61f-45a6-434e-887a-be1c7ced7700 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:28.190190 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-14b2e61f-45a6-434e-887a-be1c7ced7700 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:28.197671 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-14b2e61f-45a6-434e-887a-be1c7ced7700 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1568 microversion: 2.1 time: 0.150680 May 09 04:31:28.198244 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 351/720] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:28 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:29.214929 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-eec5c97c-393c-4296-b2a6-6adb4c05683b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:29.215546 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-eec5c97c-393c-4296-b2a6-6adb4c05683b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:29.222424 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eec5c97c-393c-4296-b2a6-6adb4c05683b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:29.222876 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eec5c97c-393c-4296-b2a6-6adb4c05683b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:29.223637 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eec5c97c-393c-4296-b2a6-6adb4c05683b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:29.224103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eec5c97c-393c-4296-b2a6-6adb4c05683b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:29.352571 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-eec5c97c-393c-4296-b2a6-6adb4c05683b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:29.360236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-eec5c97c-393c-4296-b2a6-6adb4c05683b tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1568 microversion: 2.1 time: 0.149491 May 09 04:31:29.360814 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 370/721] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:29 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:30.377916 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bc00445b-97e2-4a8d-8a43-390f77ba0ac9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:30.378458 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-bc00445b-97e2-4a8d-8a43-390f77ba0ac9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:30.385375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bc00445b-97e2-4a8d-8a43-390f77ba0ac9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:30.385804 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bc00445b-97e2-4a8d-8a43-390f77ba0ac9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:30.386596 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bc00445b-97e2-4a8d-8a43-390f77ba0ac9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:30.387031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bc00445b-97e2-4a8d-8a43-390f77ba0ac9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:30.517724 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bc00445b-97e2-4a8d-8a43-390f77ba0ac9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:30.525579 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bc00445b-97e2-4a8d-8a43-390f77ba0ac9 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1568 microversion: 2.1 time: 0.151149 May 09 04:31:30.526155 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 352/722] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:30 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:31.542666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-364ae940-8846-4234-b6f5-78c83b12f943 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:31.543224 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-364ae940-8846-4234-b6f5-78c83b12f943 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:31.550607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-364ae940-8846-4234-b6f5-78c83b12f943 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:31.551058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-364ae940-8846-4234-b6f5-78c83b12f943 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:31.551836 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-364ae940-8846-4234-b6f5-78c83b12f943 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:31.552303 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-364ae940-8846-4234-b6f5-78c83b12f943 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:31.682576 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-364ae940-8846-4234-b6f5-78c83b12f943 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:31.689935 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-364ae940-8846-4234-b6f5-78c83b12f943 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1568 microversion: 2.1 time: 0.151265 May 09 04:31:31.690525 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 371/723] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:31 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:32.177622 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9fa0fc86-75de-4444-92b1-14dff74dacd9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1421884183"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:32.178162 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9fa0fc86-75de-4444-92b1-14dff74dacd9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:32.184538 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9fa0fc86-75de-4444-92b1-14dff74dacd9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:32.184979 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9fa0fc86-75de-4444-92b1-14dff74dacd9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:32.185722 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9fa0fc86-75de-4444-92b1-14dff74dacd9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:32.186142 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9fa0fc86-75de-4444-92b1-14dff74dacd9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:32.311084 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.network.security_group_api [None req-9fa0fc86-75de-4444-92b1-14dff74dacd9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Removing security group 50344f9a-eb8f-43c1-9c05-983eb3f3a838 from port 675e6f12-2f41-46e3-b8d5-09ed37ae4a6f May 09 04:31:32.398656 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6769b0e9-3d70-4606-9d3d-9a5538e9fc9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:32.399161 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6769b0e9-3d70-4606-9d3d-9a5538e9fc9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:32.405797 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6769b0e9-3d70-4606-9d3d-9a5538e9fc9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:32.406251 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6769b0e9-3d70-4606-9d3d-9a5538e9fc9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:32.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6769b0e9-3d70-4606-9d3d-9a5538e9fc9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:32.407466 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6769b0e9-3d70-4606-9d3d-9a5538e9fc9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:32.487871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.objects.instance [None req-6769b0e9-3d70-4606-9d3d-9a5538e9fc9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lazy-loading 'services' on Instance uuid 4473a2d0-b3cc-401b-b460-7c00c66893a0 {{(pid=117033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:31:32.560007 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6769b0e9-3d70-4606-9d3d-9a5538e9fc9d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-volume_attachments/0c1ee093-b80f-411a-80bf-f4217df3af70" status: 202 len: 0 microversion: 2.1 time: 0.165004 May 09 04:31:32.560792 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 372/724] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 04:31:32 2022] DELETE /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-volume_attachments/0c1ee093-b80f-411a-80bf-f4217df3af70 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 04:31:32.569055 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-009cd315-d59f-42aa-a736-b08f77fd75aa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:32.570115 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-009cd315-d59f-42aa-a736-b08f77fd75aa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:32.576775 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-009cd315-d59f-42aa-a736-b08f77fd75aa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:32.577228 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-009cd315-d59f-42aa-a736-b08f77fd75aa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:32.578004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-009cd315-d59f-42aa-a736-b08f77fd75aa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:32.578444 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-009cd315-d59f-42aa-a736-b08f77fd75aa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:32.608268 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-009cd315-d59f-42aa-a736-b08f77fd75aa tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043096 May 09 04:31:32.609167 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 373/725] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:31:32 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:31:32.677052 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9fa0fc86-75de-4444-92b1-14dff74dacd9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "POST /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/action" status: 202 len: 0 microversion: 2.1 time: 0.501900 May 09 04:31:32.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 353/726] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 04:31:32 2022] POST /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:31:32.686882 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-c1b794dc-20b5-49fb-8ddd-6a3d132cdee4 req-8fbf3f85-5066-4f1f-b8d8-ebcb3d6f6b3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52cecb3-2634-4f9e-a9df-1ae4595bb3e1", "tag": "675e6f12-2f41-46e3-b8d5-09ed37ae4a6f"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:32.694976 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-c1b794dc-20b5-49fb-8ddd-6a3d132cdee4 req-8fbf3f85-5066-4f1f-b8d8-ebcb3d6f6b3d service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:32.695719 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-c1b794dc-20b5-49fb-8ddd-6a3d132cdee4 req-8fbf3f85-5066-4f1f-b8d8-ebcb3d6f6b3d service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:32.709367 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b042adf6-11e3-4a7e-ba09-5f652473a1d0 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:32.709992 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b042adf6-11e3-4a7e-ba09-5f652473a1d0 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:32.710138 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-c1b794dc-20b5-49fb-8ddd-6a3d132cdee4 req-8fbf3f85-5066-4f1f-b8d8-ebcb3d6f6b3d service nova] Creating event network-changed:675e6f12-2f41-46e3-b8d5-09ed37ae4a6f for instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 on hv-cinder-83800 May 09 04:31:32.716325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-c1b794dc-20b5-49fb-8ddd-6a3d132cdee4 req-8fbf3f85-5066-4f1f-b8d8-ebcb3d6f6b3d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033898 May 09 04:31:32.717513 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 374/727] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:32.721302 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b042adf6-11e3-4a7e-ba09-5f652473a1d0 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:32.721747 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b042adf6-11e3-4a7e-ba09-5f652473a1d0 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:32.722642 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b042adf6-11e3-4a7e-ba09-5f652473a1d0 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:32.722956 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b042adf6-11e3-4a7e-ba09-5f652473a1d0 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:32.888927 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b042adf6-11e3-4a7e-ba09-5f652473a1d0 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:32.902952 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b042adf6-11e3-4a7e-ba09-5f652473a1d0 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1568 microversion: 2.1 time: 0.197762 May 09 04:31:32.904085 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 354/728] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:32 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:33.621346 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a2355f05-3910-422c-8e03-0b58d281e375 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:33.622274 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a2355f05-3910-422c-8e03-0b58d281e375 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:33.628327 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a2355f05-3910-422c-8e03-0b58d281e375 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:33.628772 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a2355f05-3910-422c-8e03-0b58d281e375 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:33.629540 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a2355f05-3910-422c-8e03-0b58d281e375 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:33.629978 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a2355f05-3910-422c-8e03-0b58d281e375 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:33.659473 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a2355f05-3910-422c-8e03-0b58d281e375 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043678 May 09 04:31:33.660277 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 375/729] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:31:33 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:33.834460 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-58b45404-89db-4621-ae66-d1a5db6de921 req-0fd884bb-3709-4afd-adc3-3d02a021e5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52cecb3-2634-4f9e-a9df-1ae4595bb3e1", "tag": "675e6f12-2f41-46e3-b8d5-09ed37ae4a6f"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:33.835467 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7aeb10e0-8667-4bdf-80a3-2af703b52fdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:33.836035 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7aeb10e0-8667-4bdf-80a3-2af703b52fdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:33.855802 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7aeb10e0-8667-4bdf-80a3-2af703b52fdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:33.857535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7aeb10e0-8667-4bdf-80a3-2af703b52fdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:33.858402 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7aeb10e0-8667-4bdf-80a3-2af703b52fdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:33.858845 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-58b45404-89db-4621-ae66-d1a5db6de921 req-0fd884bb-3709-4afd-adc3-3d02a021e5f3 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:33.859401 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-58b45404-89db-4621-ae66-d1a5db6de921 req-0fd884bb-3709-4afd-adc3-3d02a021e5f3 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:33.859785 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7aeb10e0-8667-4bdf-80a3-2af703b52fdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:33.884195 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-58b45404-89db-4621-ae66-d1a5db6de921 req-0fd884bb-3709-4afd-adc3-3d02a021e5f3 service nova] Creating event network-changed:675e6f12-2f41-46e3-b8d5-09ed37ae4a6f for instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 on hv-cinder-83800 May 09 04:31:33.897764 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-58b45404-89db-4621-ae66-d1a5db6de921 req-0fd884bb-3709-4afd-adc3-3d02a021e5f3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066733 May 09 04:31:33.899076 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 376/730] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:33.923573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-49fc497f-bb6f-44bc-a206-f7b600a944f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:33.924317 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-49fc497f-bb6f-44bc-a206-f7b600a944f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:33.930886 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-49fc497f-bb6f-44bc-a206-f7b600a944f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:33.931684 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-49fc497f-bb6f-44bc-a206-f7b600a944f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:33.932919 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-49fc497f-bb6f-44bc-a206-f7b600a944f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:33.933520 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-49fc497f-bb6f-44bc-a206-f7b600a944f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:34.144684 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-49fc497f-bb6f-44bc-a206-f7b600a944f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:34.159908 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-49fc497f-bb6f-44bc-a206-f7b600a944f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1568 microversion: 2.1 time: 0.241516 May 09 04:31:34.160649 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 377/731] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:33 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:34.204265 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-7aeb10e0-8667-4bdf-80a3-2af703b52fdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lazy-loading 'services' on Instance uuid b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:31:34.307260 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7aeb10e0-8667-4bdf-80a3-2af703b52fdf tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments/ec7a0b02-2ddc-4f18-8f2e-28b67c00531b" status: 202 len: 0 microversion: 2.1 time: 0.482677 May 09 04:31:34.309048 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 355/732] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 04:31:33 2022] DELETE /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments/ec7a0b02-2ddc-4f18-8f2e-28b67c00531b => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:31:34.318076 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6e2337ec-363f-4af9-a54c-b77386236cb4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:34.319661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6e2337ec-363f-4af9-a54c-b77386236cb4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:34.326617 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6e2337ec-363f-4af9-a54c-b77386236cb4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:34.327528 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6e2337ec-363f-4af9-a54c-b77386236cb4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:34.328200 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6e2337ec-363f-4af9-a54c-b77386236cb4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:34.328744 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6e2337ec-363f-4af9-a54c-b77386236cb4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:34.375399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6e2337ec-363f-4af9-a54c-b77386236cb4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061390 May 09 04:31:34.376031 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 378/733] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:31:34 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:34.671763 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f49b94b4-3674-4981-a733-2a186580d82d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:34.672978 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f49b94b4-3674-4981-a733-2a186580d82d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:34.678990 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f49b94b4-3674-4981-a733-2a186580d82d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:34.679436 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f49b94b4-3674-4981-a733-2a186580d82d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:34.680226 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f49b94b4-3674-4981-a733-2a186580d82d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:34.680658 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f49b94b4-3674-4981-a733-2a186580d82d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:34.713426 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f49b94b4-3674-4981-a733-2a186580d82d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045132 May 09 04:31:34.714016 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 356/734] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:31:34 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 09 04:31:34.796510 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-deefdfda-a7d5-4f6c-9ff5-49f5769c70bb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:34.797068 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-deefdfda-a7d5-4f6c-9ff5-49f5769c70bb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:34.808774 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-deefdfda-a7d5-4f6c-9ff5-49f5769c70bb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:34.809224 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-deefdfda-a7d5-4f6c-9ff5-49f5769c70bb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:34.809998 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-deefdfda-a7d5-4f6c-9ff5-49f5769c70bb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:34.810432 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-deefdfda-a7d5-4f6c-9ff5-49f5769c70bb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:34.844749 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-deefdfda-a7d5-4f6c-9ff5-49f5769c70bb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Going to try to terminate instance {{(pid=117033) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:31:34.933108 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-deefdfda-a7d5-4f6c-9ff5-49f5769c70bb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 204 len: 0 microversion: 2.1 time: 0.140603 May 09 04:31:34.933841 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 379/735] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:31:34 2022] DELETE /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:31:34.942652 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-89b2feb3-e8c4-4666-a8e7-6b137f363e39 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:34.943287 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-89b2feb3-e8c4-4666-a8e7-6b137f363e39 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:34.950132 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-89b2feb3-e8c4-4666-a8e7-6b137f363e39 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:34.950581 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-89b2feb3-e8c4-4666-a8e7-6b137f363e39 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:34.951348 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-89b2feb3-e8c4-4666-a8e7-6b137f363e39 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:34.951779 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-89b2feb3-e8c4-4666-a8e7-6b137f363e39 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:35.089113 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-89b2feb3-e8c4-4666-a8e7-6b137f363e39 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:35.096484 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-89b2feb3-e8c4-4666-a8e7-6b137f363e39 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1689 microversion: 2.1 time: 0.158361 May 09 04:31:35.097058 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 357/736] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:34 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:35.177850 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b9a5f6d2-5588-45a6-884d-15b0b6c1a306 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:35.178576 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b9a5f6d2-5588-45a6-884d-15b0b6c1a306 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:35.185257 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b9a5f6d2-5588-45a6-884d-15b0b6c1a306 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:35.185649 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b9a5f6d2-5588-45a6-884d-15b0b6c1a306 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:35.186412 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b9a5f6d2-5588-45a6-884d-15b0b6c1a306 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:35.186853 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b9a5f6d2-5588-45a6-884d-15b0b6c1a306 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:35.315932 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b9a5f6d2-5588-45a6-884d-15b0b6c1a306 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:35.324219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b9a5f6d2-5588-45a6-884d-15b0b6c1a306 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1509 microversion: 2.1 time: 0.150655 May 09 04:31:35.324786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 380/737] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:35 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:35.340794 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-10d57014-66f4-4925-8cda-69594009ca55 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:35.341355 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-10d57014-66f4-4925-8cda-69594009ca55 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:35.347213 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10d57014-66f4-4925-8cda-69594009ca55 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:35.347649 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10d57014-66f4-4925-8cda-69594009ca55 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:35.348430 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10d57014-66f4-4925-8cda-69594009ca55 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:35.348854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10d57014-66f4-4925-8cda-69594009ca55 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:35.387050 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-209078ae-19ea-4daf-aa11-d8d2ac7b32db tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:35.388001 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-209078ae-19ea-4daf-aa11-d8d2ac7b32db tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:35.394283 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-209078ae-19ea-4daf-aa11-d8d2ac7b32db tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:35.394726 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-209078ae-19ea-4daf-aa11-d8d2ac7b32db tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:35.395488 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-209078ae-19ea-4daf-aa11-d8d2ac7b32db tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:35.395949 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-209078ae-19ea-4daf-aa11-d8d2ac7b32db tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:35.423201 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-10d57014-66f4-4925-8cda-69594009ca55 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "POST /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d/action" status: 202 len: 0 microversion: 2.1 time: 0.086643 May 09 04:31:35.424137 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 358/738] 10.222.0.44 () {60 vars in 1277 bytes} [Mon May 9 04:31:35 2022] POST /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:31:35.427640 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-209078ae-19ea-4daf-aa11-d8d2ac7b32db tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044916 May 09 04:31:35.428401 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 381/739] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:31:35 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:31:35.432991 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d4d066f9-e0f4-4cc7-a3ff-7b778425a574 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:35.433600 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d4d066f9-e0f4-4cc7-a3ff-7b778425a574 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:35.439670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d4d066f9-e0f4-4cc7-a3ff-7b778425a574 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:35.440100 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d4d066f9-e0f4-4cc7-a3ff-7b778425a574 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:35.440870 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d4d066f9-e0f4-4cc7-a3ff-7b778425a574 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:35.441306 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d4d066f9-e0f4-4cc7-a3ff-7b778425a574 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:35.608193 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d4d066f9-e0f4-4cc7-a3ff-7b778425a574 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:35.615537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d4d066f9-e0f4-4cc7-a3ff-7b778425a574 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1517 microversion: 2.1 time: 0.187407 May 09 04:31:35.616146 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 359/740] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:35 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:36.166422 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-686a88bb-1ea2-48cc-8c09-3b2ee47299b1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:36.167034 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-686a88bb-1ea2-48cc-8c09-3b2ee47299b1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:36.172985 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-686a88bb-1ea2-48cc-8c09-3b2ee47299b1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:36.173443 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-686a88bb-1ea2-48cc-8c09-3b2ee47299b1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:36.174182 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-686a88bb-1ea2-48cc-8c09-3b2ee47299b1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:36.174611 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-686a88bb-1ea2-48cc-8c09-3b2ee47299b1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:36.305113 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-686a88bb-1ea2-48cc-8c09-3b2ee47299b1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:36.312733 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-686a88bb-1ea2-48cc-8c09-3b2ee47299b1 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1689 microversion: 2.1 time: 0.203135 May 09 04:31:36.313308 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 382/741] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:36 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1689 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:36.439669 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-60abadd7-4d42-4ecf-8b6e-25fa4f25a33a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:36.440687 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-60abadd7-4d42-4ecf-8b6e-25fa4f25a33a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:36.447995 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-60abadd7-4d42-4ecf-8b6e-25fa4f25a33a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:36.448416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-60abadd7-4d42-4ecf-8b6e-25fa4f25a33a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:36.449176 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-60abadd7-4d42-4ecf-8b6e-25fa4f25a33a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:36.449607 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-60abadd7-4d42-4ecf-8b6e-25fa4f25a33a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:36.478492 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-60abadd7-4d42-4ecf-8b6e-25fa4f25a33a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042624 May 09 04:31:36.479162 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 360/742] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:31:36 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:36.632442 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-59118217-80fc-4a0f-bb28-0a12341a6ba4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:36.632989 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-59118217-80fc-4a0f-bb28-0a12341a6ba4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:36.640286 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-59118217-80fc-4a0f-bb28-0a12341a6ba4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:36.640737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-59118217-80fc-4a0f-bb28-0a12341a6ba4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:36.641501 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-59118217-80fc-4a0f-bb28-0a12341a6ba4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:36.641947 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-59118217-80fc-4a0f-bb28-0a12341a6ba4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:36.680754 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7a8fae94-9bcc-4921-9c2c-76f6d0de99f6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:36.682318 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7a8fae94-9bcc-4921-9c2c-76f6d0de99f6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:36.688446 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a8fae94-9bcc-4921-9c2c-76f6d0de99f6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:36.688896 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a8fae94-9bcc-4921-9c2c-76f6d0de99f6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:36.689671 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a8fae94-9bcc-4921-9c2c-76f6d0de99f6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:36.690104 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a8fae94-9bcc-4921-9c2c-76f6d0de99f6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:36.715235 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7a8fae94-9bcc-4921-9c2c-76f6d0de99f6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:31:36.773044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-59118217-80fc-4a0f-bb28-0a12341a6ba4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:36.780746 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-59118217-80fc-4a0f-bb28-0a12341a6ba4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1517 microversion: 2.1 time: 0.152356 May 09 04:31:36.781537 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 383/743] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:36 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:36.792901 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7a8fae94-9bcc-4921-9c2c-76f6d0de99f6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 204 len: 0 microversion: 2.1 time: 0.115710 May 09 04:31:36.795972 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 361/744] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:31:36 2022] DELETE /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 04:31:36.801327 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d76b2f9b-764f-4a54-8e16-eff10102e61d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:36.801935 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d76b2f9b-764f-4a54-8e16-eff10102e61d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:36.808521 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d76b2f9b-764f-4a54-8e16-eff10102e61d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:36.808969 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d76b2f9b-764f-4a54-8e16-eff10102e61d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:36.809734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d76b2f9b-764f-4a54-8e16-eff10102e61d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:36.810173 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d76b2f9b-764f-4a54-8e16-eff10102e61d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:36.937206 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d76b2f9b-764f-4a54-8e16-eff10102e61d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:36.944538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d76b2f9b-764f-4a54-8e16-eff10102e61d tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1578 microversion: 2.1 time: 0.146936 May 09 04:31:36.945105 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 384/745] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:36 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1578 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:37.330695 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9b0e548a-518c-4b7d-b665-fd25852ab867 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:37.331384 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9b0e548a-518c-4b7d-b665-fd25852ab867 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:37.337318 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9b0e548a-518c-4b7d-b665-fd25852ab867 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:37.337963 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9b0e548a-518c-4b7d-b665-fd25852ab867 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:37.338965 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9b0e548a-518c-4b7d-b665-fd25852ab867 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:37.339391 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9b0e548a-518c-4b7d-b665-fd25852ab867 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:37.467264 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9b0e548a-518c-4b7d-b665-fd25852ab867 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:37.474704 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9b0e548a-518c-4b7d-b665-fd25852ab867 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1689 microversion: 2.1 time: 0.148184 May 09 04:31:37.475354 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 362/746] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:37 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:37.489948 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-eca85d29-94b1-4def-a543-05563cc2f048 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:37.490985 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-eca85d29-94b1-4def-a543-05563cc2f048 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:37.496926 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eca85d29-94b1-4def-a543-05563cc2f048 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:37.497377 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eca85d29-94b1-4def-a543-05563cc2f048 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:37.498137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eca85d29-94b1-4def-a543-05563cc2f048 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:37.498573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eca85d29-94b1-4def-a543-05563cc2f048 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:37.526694 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-eca85d29-94b1-4def-a543-05563cc2f048 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040576 May 09 04:31:37.527175 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 385/747] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:31:37 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:37.798432 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b1916f94-4823-4e40-a3a6-3e2d68c631bc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:37.798996 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b1916f94-4823-4e40-a3a6-3e2d68c631bc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:37.804905 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1916f94-4823-4e40-a3a6-3e2d68c631bc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:37.805342 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1916f94-4823-4e40-a3a6-3e2d68c631bc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:37.806129 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1916f94-4823-4e40-a3a6-3e2d68c631bc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:37.806746 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1916f94-4823-4e40-a3a6-3e2d68c631bc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:37.933855 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b1916f94-4823-4e40-a3a6-3e2d68c631bc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:37.941953 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b1916f94-4823-4e40-a3a6-3e2d68c631bc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1517 microversion: 2.1 time: 0.147416 May 09 04:31:37.942524 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 363/748] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:37 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1517 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:37.962132 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-64b2ed15-8fde-4c25-8151-88f03c781561 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:37.963838 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-64b2ed15-8fde-4c25-8151-88f03c781561 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:37.970137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-64b2ed15-8fde-4c25-8151-88f03c781561 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:37.970587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-64b2ed15-8fde-4c25-8151-88f03c781561 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:37.971351 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-64b2ed15-8fde-4c25-8151-88f03c781561 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:37.971790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-64b2ed15-8fde-4c25-8151-88f03c781561 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:38.102607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-64b2ed15-8fde-4c25-8151-88f03c781561 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:38.110299 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-64b2ed15-8fde-4c25-8151-88f03c781561 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1578 microversion: 2.1 time: 0.151900 May 09 04:31:38.110866 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 386/749] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:37 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:38.323436 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-7b4186e8-a915-4886-b370-5a42e9ff9a89 req-79b28f4d-4cf0-4c92-88dc-ec6a1e2190ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a541a008-c541-407b-8868-a2b9d98ed15d", "name": "network-vif-unplugged", "status": "completed", "tag": "8b3c8f68-461e-4b7f-843a-747af41739b1"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:38.331203 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-7b4186e8-a915-4886-b370-5a42e9ff9a89 req-79b28f4d-4cf0-4c92-88dc-ec6a1e2190ff service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:38.331647 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-7b4186e8-a915-4886-b370-5a42e9ff9a89 req-79b28f4d-4cf0-4c92-88dc-ec6a1e2190ff service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:38.343133 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.compute.server_external_events [req-7b4186e8-a915-4886-b370-5a42e9ff9a89 req-79b28f4d-4cf0-4c92-88dc-ec6a1e2190ff service nova] Unable to find a host for instance a541a008-c541-407b-8868-a2b9d98ed15d. Dropping event network-vif-unplugged {{(pid=117032) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 09 04:31:38.344015 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-7b4186e8-a915-4886-b370-5a42e9ff9a89 req-79b28f4d-4cf0-4c92-88dc-ec6a1e2190ff service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025014 May 09 04:31:38.344603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 364/750] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 09 04:31:38.492614 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-111c29d7-8df8-4c06-9be1-356c02ca91e7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:38.493256 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-111c29d7-8df8-4c06-9be1-356c02ca91e7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:38.499839 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-111c29d7-8df8-4c06-9be1-356c02ca91e7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:38.500320 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-111c29d7-8df8-4c06-9be1-356c02ca91e7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:38.501164 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-111c29d7-8df8-4c06-9be1-356c02ca91e7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:38.501606 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-111c29d7-8df8-4c06-9be1-356c02ca91e7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:38.539221 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fe3c4df6-870c-4e90-bfca-b25b96ca85c4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:38.541402 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fe3c4df6-870c-4e90-bfca-b25b96ca85c4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:38.548612 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fe3c4df6-870c-4e90-bfca-b25b96ca85c4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:38.549055 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fe3c4df6-870c-4e90-bfca-b25b96ca85c4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:38.549824 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fe3c4df6-870c-4e90-bfca-b25b96ca85c4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:38.550258 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fe3c4df6-870c-4e90-bfca-b25b96ca85c4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:38.581295 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fe3c4df6-870c-4e90-bfca-b25b96ca85c4 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046897 May 09 04:31:38.581948 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 365/751] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:31:38 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:31:38.633151 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-111c29d7-8df8-4c06-9be1-356c02ca91e7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:38.640556 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-111c29d7-8df8-4c06-9be1-356c02ca91e7 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1689 microversion: 2.1 time: 0.151796 May 09 04:31:38.641125 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 387/752] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:38 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:38.960641 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c054d04f-140e-4c79-8d47-f53e9447cea2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:38.961171 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c054d04f-140e-4c79-8d47-f53e9447cea2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:38.967846 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c054d04f-140e-4c79-8d47-f53e9447cea2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:38.968327 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c054d04f-140e-4c79-8d47-f53e9447cea2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:38.969090 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c054d04f-140e-4c79-8d47-f53e9447cea2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:38.969527 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c054d04f-140e-4c79-8d47-f53e9447cea2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:39.100701 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c054d04f-140e-4c79-8d47-f53e9447cea2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:39.108700 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c054d04f-140e-4c79-8d47-f53e9447cea2 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1517 microversion: 2.1 time: 0.152048 May 09 04:31:39.109283 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 366/753] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:38 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:39.126265 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8247b762-520f-4331-a948-53d3e04d0594 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:39.126881 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8247b762-520f-4331-a948-53d3e04d0594 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:39.133165 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8247b762-520f-4331-a948-53d3e04d0594 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:39.133611 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8247b762-520f-4331-a948-53d3e04d0594 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:39.134372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8247b762-520f-4331-a948-53d3e04d0594 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:39.134803 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8247b762-520f-4331-a948-53d3e04d0594 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:39.265586 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8247b762-520f-4331-a948-53d3e04d0594 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:39.273083 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8247b762-520f-4331-a948-53d3e04d0594 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1578 microversion: 2.1 time: 0.150567 May 09 04:31:39.273664 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 388/754] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:39 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:39.594137 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-41950edb-a638-45ef-abbe-1676fb25b68a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:39.595061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-41950edb-a638-45ef-abbe-1676fb25b68a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:39.601374 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-41950edb-a638-45ef-abbe-1676fb25b68a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:39.601808 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-41950edb-a638-45ef-abbe-1676fb25b68a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:39.602552 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-41950edb-a638-45ef-abbe-1676fb25b68a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:39.603012 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-41950edb-a638-45ef-abbe-1676fb25b68a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:39.631237 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-41950edb-a638-45ef-abbe-1676fb25b68a tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041030 May 09 04:31:39.631789 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 367/755] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:31:39 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:39.657312 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-7f1d6301-a8af-4b87-8b65-087f31eeaf45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:39.657918 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-7f1d6301-a8af-4b87-8b65-087f31eeaf45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:39.663754 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7f1d6301-a8af-4b87-8b65-087f31eeaf45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:39.664231 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7f1d6301-a8af-4b87-8b65-087f31eeaf45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:39.664983 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7f1d6301-a8af-4b87-8b65-087f31eeaf45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:39.665636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7f1d6301-a8af-4b87-8b65-087f31eeaf45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:39.791380 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-7f1d6301-a8af-4b87-8b65-087f31eeaf45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:39.799727 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-7f1d6301-a8af-4b87-8b65-087f31eeaf45 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1689 microversion: 2.1 time: 0.146103 May 09 04:31:39.800579 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 389/756] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:39 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:40.126322 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2c0ab729-3545-4c5d-8e5f-87c2586a2023 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:40.126924 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2c0ab729-3545-4c5d-8e5f-87c2586a2023 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:40.132797 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2c0ab729-3545-4c5d-8e5f-87c2586a2023 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:40.133233 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2c0ab729-3545-4c5d-8e5f-87c2586a2023 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:40.133983 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2c0ab729-3545-4c5d-8e5f-87c2586a2023 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:40.134501 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2c0ab729-3545-4c5d-8e5f-87c2586a2023 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:40.291453 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c50e652a-5083-44ae-b899-09fd11b0ab2c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:40.292565 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c50e652a-5083-44ae-b899-09fd11b0ab2c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:40.304055 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c50e652a-5083-44ae-b899-09fd11b0ab2c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:40.307508 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c50e652a-5083-44ae-b899-09fd11b0ab2c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:40.310221 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c50e652a-5083-44ae-b899-09fd11b0ab2c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:40.312013 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c50e652a-5083-44ae-b899-09fd11b0ab2c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:40.382198 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2c0ab729-3545-4c5d-8e5f-87c2586a2023 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:40.390623 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2c0ab729-3545-4c5d-8e5f-87c2586a2023 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1517 microversion: 2.1 time: 0.268191 May 09 04:31:40.391644 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 368/757] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:40 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1517 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:40.581485 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c50e652a-5083-44ae-b899-09fd11b0ab2c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:40.590929 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c50e652a-5083-44ae-b899-09fd11b0ab2c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1578 microversion: 2.1 time: 0.304198 May 09 04:31:40.591704 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 390/758] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:40 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1578 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:40.642929 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fb8e85ae-e44f-40a8-85ea-158ea47ce141 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:40.644026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fb8e85ae-e44f-40a8-85ea-158ea47ce141 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:40.651526 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb8e85ae-e44f-40a8-85ea-158ea47ce141 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:40.651996 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb8e85ae-e44f-40a8-85ea-158ea47ce141 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:40.652763 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb8e85ae-e44f-40a8-85ea-158ea47ce141 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:40.653471 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb8e85ae-e44f-40a8-85ea-158ea47ce141 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:40.688262 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fb8e85ae-e44f-40a8-85ea-158ea47ce141 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049372 May 09 04:31:40.688841 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 369/759] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:31:40 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 04:31:40.698969 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-7abbad9f-a8ec-41af-b415-834dd3a6a6c9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:40.699509 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-7abbad9f-a8ec-41af-b415-834dd3a6a6c9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:40.705537 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7abbad9f-a8ec-41af-b415-834dd3a6a6c9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:40.706060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7abbad9f-a8ec-41af-b415-834dd3a6a6c9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:40.706914 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7abbad9f-a8ec-41af-b415-834dd3a6a6c9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:40.707421 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7abbad9f-a8ec-41af-b415-834dd3a6a6c9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:40.789741 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-7abbad9f-a8ec-41af-b415-834dd3a6a6c9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] HTTP exception thrown: Instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 is not attached to volume ec7a0b02-2ddc-4f18-8f2e-28b67c00531b May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-7abbad9f-a8ec-41af-b415-834dd3a6a6c9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Request method failure captured: May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: DELETE /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments/ec7a0b02-2ddc-4f18-8f2e-28b67c00531b HTTP/1.1 May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJhMMjHQQ37dp6oN8VDYHU53ZYw1AqMR-TQ2h6Q6fbad2FafRPjwPqFge-yckPJip6NxkNBiql3ALMPL0z1BJKYg3BcoVVHehuuLPer3fmvzREQf7RESeigRgsVFaAmMmR1xe1lPQACYpQHQALRVpwDijILOdYRRGN-wtuc8TBQDlTo May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: cf2a64ab3bc1448b8a934e2d103bb161 May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-TestMinimumBasicScenario-890725566 May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:31:40.800573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:31:40.802075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cf2a64ab3bc1448b8a934e2d103bb161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf2a64ab3bc1448b8a934e2d103bb161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf2a64ab3bc1448b8a934e2d103bb161"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cf2a64ab3bc1448b8a934e2d103bb161"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:31:40.802075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-TestMinimumBasicScenario-890725566 May 09 04:31:40.802075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: cf2a64ab3bc1448b8a934e2d103bb161 May 09 04:31:40.802075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-TestMinimumBasicScenario-890725566 May 09 04:31:40.802075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-TestMinimumBasicScenario-890725566-project May 09 04:31:40.802075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:31:40.802075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:31:40.802075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 25e4c84bd2174040a20fa9c60ddb6b55 May 09 04:31:40.802075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-TestMinimumBasicScenario-890725566-project May 09 04:31:40.802075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:31:40.802075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 is not attached to volume ec7a0b02-2ddc-4f18-8f2e-28b67c00531b May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'server_id': 'b52cecb3-2634-4f9e-a9df-1ae4595bb3e1', 'id': 'ec7a0b02-2ddc-4f18-8f2e-28b67c00531b'} May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ec7a0b02-2ddc-4f18-8f2e-28b67c00531b. May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:31:40.802913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 is not attached to volume ec7a0b02-2ddc-4f18-8f2e-28b67c00531b May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 is not attached to volume ec7a0b02-2ddc-4f18-8f2e-28b67c00531b May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:31:40.804141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-7abbad9f-a8ec-41af-b415-834dd3a6a6c9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Returning 404 to user: Instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 is not attached to volume ec7a0b02-2ddc-4f18-8f2e-28b67c00531b {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:31:40.805032 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-7abbad9f-a8ec-41af-b415-834dd3a6a6c9 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments/ec7a0b02-2ddc-4f18-8f2e-28b67c00531b" status: 404 len: 154 microversion: 2.1 time: 0.107365 May 09 04:31:40.805032 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 391/760] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 04:31:40 2022] DELETE /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1/os-volume_attachments/ec7a0b02-2ddc-4f18-8f2e-28b67c00531b => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:31:40.823839 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6a9816d7-5b0e-4294-a35f-0429ee371738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:40.824855 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6a9816d7-5b0e-4294-a35f-0429ee371738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:40.833116 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a9816d7-5b0e-4294-a35f-0429ee371738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:40.833564 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a9816d7-5b0e-4294-a35f-0429ee371738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:40.834555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a9816d7-5b0e-4294-a35f-0429ee371738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:40.834989 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a9816d7-5b0e-4294-a35f-0429ee371738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:41.408785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c2f607ab-1744-4e3f-b0b1-f2a0136180e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:41.409401 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c2f607ab-1744-4e3f-b0b1-f2a0136180e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:41.416621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c2f607ab-1744-4e3f-b0b1-f2a0136180e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:41.417074 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c2f607ab-1744-4e3f-b0b1-f2a0136180e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:41.417881 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c2f607ab-1744-4e3f-b0b1-f2a0136180e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:41.418314 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c2f607ab-1744-4e3f-b0b1-f2a0136180e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:41.441686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6a9816d7-5b0e-4294-a35f-0429ee371738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:41.461257 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6a9816d7-5b0e-4294-a35f-0429ee371738 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1689 microversion: 2.1 time: 0.647580 May 09 04:31:41.463972 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 370/761] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:40 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1689 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:41.609749 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-34977715-738a-4814-ac3a-e45bd99cf327 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:41.610821 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-34977715-738a-4814-ac3a-e45bd99cf327 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:41.617582 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34977715-738a-4814-ac3a-e45bd99cf327 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:41.618175 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34977715-738a-4814-ac3a-e45bd99cf327 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:41.619311 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34977715-738a-4814-ac3a-e45bd99cf327 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:41.619846 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34977715-738a-4814-ac3a-e45bd99cf327 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:41.634796 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c2f607ab-1744-4e3f-b0b1-f2a0136180e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:41.647163 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c2f607ab-1744-4e3f-b0b1-f2a0136180e7 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.242108 May 09 04:31:41.648312 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 392/762] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:41 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:41.957624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-34977715-738a-4814-ac3a-e45bd99cf327 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:41.970147 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5c84be2b-24c7-4bce-9a22-52dfd37de4bc tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:41.972089 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5c84be2b-24c7-4bce-9a22-52dfd37de4bc tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:41.974150 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-34977715-738a-4814-ac3a-e45bd99cf327 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1578 microversion: 2.1 time: 0.369075 May 09 04:31:41.979123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5c84be2b-24c7-4bce-9a22-52dfd37de4bc tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:41.979794 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5c84be2b-24c7-4bce-9a22-52dfd37de4bc tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:41.980773 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5c84be2b-24c7-4bce-9a22-52dfd37de4bc tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:41.981364 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5c84be2b-24c7-4bce-9a22-52dfd37de4bc tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:41.987318 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 371/763] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:41 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1578 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:42.006506 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5c84be2b-24c7-4bce-9a22-52dfd37de4bc tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Going to try to terminate instance {{(pid=117033) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:31:42.101060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5c84be2b-24c7-4bce-9a22-52dfd37de4bc tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 204 len: 0 microversion: 2.1 time: 0.134414 May 09 04:31:42.102577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 393/764] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:31:41 2022] DELETE /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:31:42.111536 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2f0c9a9d-0d47-4e2b-927e-ce5d7a3b6400 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:42.112264 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2f0c9a9d-0d47-4e2b-927e-ce5d7a3b6400 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:42.120951 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2f0c9a9d-0d47-4e2b-927e-ce5d7a3b6400 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:42.121454 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2f0c9a9d-0d47-4e2b-927e-ce5d7a3b6400 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:42.122239 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2f0c9a9d-0d47-4e2b-927e-ce5d7a3b6400 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:42.122727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2f0c9a9d-0d47-4e2b-927e-ce5d7a3b6400 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:42.396681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2f0c9a9d-0d47-4e2b-927e-ce5d7a3b6400 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:42.408437 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2f0c9a9d-0d47-4e2b-927e-ce5d7a3b6400 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1554 microversion: 2.1 time: 0.301257 May 09 04:31:42.419546 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 372/765] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:42 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1554 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:42.462799 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-163a3b46-6e74-4899-a8ab-5ada1f601534 req-4b27b25f-9abf-45c4-8cf2-28fb60a397d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4473a2d0-b3cc-401b-b460-7c00c66893a0", "name": "network-vif-deleted", "tag": "ef4e419e-4415-4b7c-b72d-4dbd68f98b15"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:42.471250 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-163a3b46-6e74-4899-a8ab-5ada1f601534 req-4b27b25f-9abf-45c4-8cf2-28fb60a397d6 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:42.471878 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-163a3b46-6e74-4899-a8ab-5ada1f601534 req-4b27b25f-9abf-45c4-8cf2-28fb60a397d6 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:42.481738 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-06f2d2ed-0012-4971-9c53-54d0ab6ec4dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:42.482474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-06f2d2ed-0012-4971-9c53-54d0ab6ec4dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:42.488356 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-163a3b46-6e74-4899-a8ab-5ada1f601534 req-4b27b25f-9abf-45c4-8cf2-28fb60a397d6 service nova] Creating event network-vif-deleted:ef4e419e-4415-4b7c-b72d-4dbd68f98b15 for instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 on hv-cinder-83800 May 09 04:31:42.488849 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-06f2d2ed-0012-4971-9c53-54d0ab6ec4dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:42.489400 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-06f2d2ed-0012-4971-9c53-54d0ab6ec4dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:42.490403 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-06f2d2ed-0012-4971-9c53-54d0ab6ec4dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:42.490965 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-06f2d2ed-0012-4971-9c53-54d0ab6ec4dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:42.497176 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-163a3b46-6e74-4899-a8ab-5ada1f601534 req-4b27b25f-9abf-45c4-8cf2-28fb60a397d6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124534 May 09 04:31:42.498374 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 394/766] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:31:42.562311 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-06f2d2ed-0012-4971-9c53-54d0ab6ec4dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:42.570488 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-06f2d2ed-0012-4971-9c53-54d0ab6ec4dc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1621 microversion: 2.1 time: 0.093392 May 09 04:31:42.577901 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 373/767] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:42 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1621 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:42.665742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5e68b1e5-0fe1-4fc2-836c-9e134e3b3fa8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:42.666601 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5e68b1e5-0fe1-4fc2-836c-9e134e3b3fa8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:42.672892 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5e68b1e5-0fe1-4fc2-836c-9e134e3b3fa8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:42.673446 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5e68b1e5-0fe1-4fc2-836c-9e134e3b3fa8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:42.674360 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5e68b1e5-0fe1-4fc2-836c-9e134e3b3fa8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:42.674885 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5e68b1e5-0fe1-4fc2-836c-9e134e3b3fa8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:42.821257 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5e68b1e5-0fe1-4fc2-836c-9e134e3b3fa8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:42.829686 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5e68b1e5-0fe1-4fc2-836c-9e134e3b3fa8 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.168043 May 09 04:31:42.830485 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 395/768] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:42 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:42.994332 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a3f3a854-5c94-4e7a-8bf7-32fbf38eb2b2 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:42.995777 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a3f3a854-5c94-4e7a-8bf7-32fbf38eb2b2 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:43.002543 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a3f3a854-5c94-4e7a-8bf7-32fbf38eb2b2 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:43.003065 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a3f3a854-5c94-4e7a-8bf7-32fbf38eb2b2 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:43.003923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a3f3a854-5c94-4e7a-8bf7-32fbf38eb2b2 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:43.004468 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a3f3a854-5c94-4e7a-8bf7-32fbf38eb2b2 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:43.071115 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a3f3a854-5c94-4e7a-8bf7-32fbf38eb2b2 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:43.080187 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a3f3a854-5c94-4e7a-8bf7-32fbf38eb2b2 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1510 microversion: 2.1 time: 0.090199 May 09 04:31:43.080958 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 374/769] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:42 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1510 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:43.426476 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-cd38e549-d46c-46b0-84d1-496730a5d548 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:43.427646 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-cd38e549-d46c-46b0-84d1-496730a5d548 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:43.434954 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd38e549-d46c-46b0-84d1-496730a5d548 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:43.435416 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd38e549-d46c-46b0-84d1-496730a5d548 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:43.436616 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd38e549-d46c-46b0-84d1-496730a5d548 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:43.437311 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd38e549-d46c-46b0-84d1-496730a5d548 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:43.587825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-97d885e9-9531-47fa-b78b-93757a3926cc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:43.588862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-97d885e9-9531-47fa-b78b-93757a3926cc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:43.589059 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-cd38e549-d46c-46b0-84d1-496730a5d548 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:43.595048 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-97d885e9-9531-47fa-b78b-93757a3926cc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:43.595497 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-97d885e9-9531-47fa-b78b-93757a3926cc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:43.596567 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-97d885e9-9531-47fa-b78b-93757a3926cc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:43.597005 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-97d885e9-9531-47fa-b78b-93757a3926cc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:43.597353 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-cd38e549-d46c-46b0-84d1-496730a5d548 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1554 microversion: 2.1 time: 0.174896 May 09 04:31:43.598029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 396/770] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:43 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:43.660607 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-97d885e9-9531-47fa-b78b-93757a3926cc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:43.668048 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-97d885e9-9531-47fa-b78b-93757a3926cc tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1621 microversion: 2.1 time: 0.084565 May 09 04:31:43.668620 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 375/771] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:43 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1621 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:43.847402 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ca218e70-6ac2-45fd-a5db-06cbdb4636c5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:43.847999 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ca218e70-6ac2-45fd-a5db-06cbdb4636c5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:43.854442 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ca218e70-6ac2-45fd-a5db-06cbdb4636c5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:43.854877 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ca218e70-6ac2-45fd-a5db-06cbdb4636c5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:43.855629 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ca218e70-6ac2-45fd-a5db-06cbdb4636c5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:43.856161 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ca218e70-6ac2-45fd-a5db-06cbdb4636c5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:43.983059 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ca218e70-6ac2-45fd-a5db-06cbdb4636c5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:43.990376 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ca218e70-6ac2-45fd-a5db-06cbdb4636c5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.146817 May 09 04:31:43.990956 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 397/772] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:43 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:44.097730 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-db7467ea-9c1f-4969-9988-38cc4bae511a tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:44.098281 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-db7467ea-9c1f-4969-9988-38cc4bae511a tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:44.105234 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-db7467ea-9c1f-4969-9988-38cc4bae511a tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:44.105681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-db7467ea-9c1f-4969-9988-38cc4bae511a tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:44.106443 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-db7467ea-9c1f-4969-9988-38cc4bae511a tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:44.106877 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-db7467ea-9c1f-4969-9988-38cc4bae511a tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:44.172474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-db7467ea-9c1f-4969-9988-38cc4bae511a tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:44.179782 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-db7467ea-9c1f-4969-9988-38cc4bae511a tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 200 len: 1225 microversion: 2.1 time: 0.086021 May 09 04:31:44.180394 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 376/773] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:44 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:44.512083 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-db01d7f3-5881-42c8-ab3b-1c6cb4e68855 req-129c7299-95f4-4e2e-9f33-bf751b22a428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25d4ade-5644-40c6-81ca-73ccc85df6e1", "name": "network-vif-deleted", "tag": "f61a276d-0cef-4028-b9cc-fe9fb05d4f49"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:44.520467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-db01d7f3-5881-42c8-ab3b-1c6cb4e68855 req-129c7299-95f4-4e2e-9f33-bf751b22a428 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:44.520942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-db01d7f3-5881-42c8-ab3b-1c6cb4e68855 req-129c7299-95f4-4e2e-9f33-bf751b22a428 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:44.532216 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-db01d7f3-5881-42c8-ab3b-1c6cb4e68855 req-129c7299-95f4-4e2e-9f33-bf751b22a428 service nova] Creating event network-vif-deleted:f61a276d-0cef-4028-b9cc-fe9fb05d4f49 for instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 on hv-cinder-83800 May 09 04:31:44.536825 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-db01d7f3-5881-42c8-ab3b-1c6cb4e68855 req-129c7299-95f4-4e2e-9f33-bf751b22a428 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028695 May 09 04:31:44.537615 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 398/774] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:44.614235 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ca993941-6c13-4386-86e3-678fb12edf61 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:44.614844 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ca993941-6c13-4386-86e3-678fb12edf61 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:44.621529 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ca993941-6c13-4386-86e3-678fb12edf61 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:44.621975 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ca993941-6c13-4386-86e3-678fb12edf61 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:44.622791 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ca993941-6c13-4386-86e3-678fb12edf61 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:44.623222 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ca993941-6c13-4386-86e3-678fb12edf61 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:44.685141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1b0d322d-fb2f-4c4c-986d-825854730b17 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:44.686074 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1b0d322d-fb2f-4c4c-986d-825854730b17 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:44.695874 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1b0d322d-fb2f-4c4c-986d-825854730b17 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:44.696410 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1b0d322d-fb2f-4c4c-986d-825854730b17 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:44.697858 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1b0d322d-fb2f-4c4c-986d-825854730b17 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:44.698378 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1b0d322d-fb2f-4c4c-986d-825854730b17 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:44.732073 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1b0d322d-fb2f-4c4c-986d-825854730b17 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:44.732515 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1b0d322d-fb2f-4c4c-986d-825854730b17 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:44.732961 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.objects.instance [None req-1b0d322d-fb2f-4c4c-986d-825854730b17 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lazy-loading 'fault' on Instance uuid 4473a2d0-b3cc-401b-b460-7c00c66893a0 {{(pid=117033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:31:44.779004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1b0d322d-fb2f-4c4c-986d-825854730b17 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:44.786407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1b0d322d-fb2f-4c4c-986d-825854730b17 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 200 len: 1334 microversion: 2.1 time: 0.105609 May 09 04:31:44.786981 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 399/775] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:44 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 1334 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:44.799115 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ca993941-6c13-4386-86e3-678fb12edf61 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:44.806327 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ca993941-6c13-4386-86e3-678fb12edf61 tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1554 microversion: 2.1 time: 0.195961 May 09 04:31:44.806888 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 377/776] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:44 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:45.008766 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3beecefe-80b4-44d6-9e53-0a0804f9d854 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:45.010226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-3beecefe-80b4-44d6-9e53-0a0804f9d854 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:45.016660 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3beecefe-80b4-44d6-9e53-0a0804f9d854 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:45.017113 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3beecefe-80b4-44d6-9e53-0a0804f9d854 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:45.018067 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3beecefe-80b4-44d6-9e53-0a0804f9d854 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:45.018560 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3beecefe-80b4-44d6-9e53-0a0804f9d854 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:45.170356 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3beecefe-80b4-44d6-9e53-0a0804f9d854 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:45.177867 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-3beecefe-80b4-44d6-9e53-0a0804f9d854 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.173633 May 09 04:31:45.178440 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 400/777] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:45 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:45.196938 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e747a31d-790c-410a-8a70-6919aa3ca940 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:45.197651 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e747a31d-790c-410a-8a70-6919aa3ca940 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:45.204027 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e747a31d-790c-410a-8a70-6919aa3ca940 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:45.204544 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e747a31d-790c-410a-8a70-6919aa3ca940 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:45.205371 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e747a31d-790c-410a-8a70-6919aa3ca940 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:45.205876 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e747a31d-790c-410a-8a70-6919aa3ca940 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:45.220687 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-e747a31d-790c-410a-8a70-6919aa3ca940 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] HTTP exception thrown: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e747a31d-790c-410a-8a70-6919aa3ca940 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Request method failure captured: May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 HTTP/1.1 May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJhI51Wg1Mh0rXGOkYOhY83gb_85EjAt1dEmV1kwE0E_o-LiDKJllKOYr3RwG8f3fHxZOUeUK-csXwRQGpzve9cTiuCA61_bQOHZ34MipY7rEN8cB_wKoIShklm1dipRQISHpvPSUx9JtSjPLpJy7unxRoJ2iMKpKc2lIb5aD3hB-Co May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: b6223852af9c4361b99a24e7a49a7734 May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-TestVolumeBootPattern-1800052824 May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:31:45.222321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:31:45.223729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:31:45.223729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-TestVolumeBootPattern-1800052824 May 09 04:31:45.223729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: b6223852af9c4361b99a24e7a49a7734 May 09 04:31:45.223729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800052824 May 09 04:31:45.223729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-TestVolumeBootPattern-1800052824-project May 09 04:31:45.223729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:31:45.223729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:31:45.223729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: cb34feb512764ec5b9ca25c30c3d7159 May 09 04:31:45.223729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-TestVolumeBootPattern-1800052824-project May 09 04:31:45.223729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:31:45.223729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:31:45.223729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': 'd25d4ade-5644-40c6-81ca-73ccc85df6e1'} May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:31:45.224699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:31:45.225923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:45.226990 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e747a31d-790c-410a-8a70-6919aa3ca940 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Returning 404 to user: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:31:45.226990 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e747a31d-790c-410a-8a70-6919aa3ca940 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 404 len: 111 microversion: 2.1 time: 0.030770 May 09 04:31:45.226990 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 378/778] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:45 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:31:45.272700 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-999410906", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-901938689", "security_groups": [{"name": "tempest-secgroup-smoke-1544934256"}], "block_device_mapping_v2": [{"uuid": "009defab-9544-4bb4-9e68-bcc76ec37ad1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d0b894fb-ca2e-4f02-9d2e-0b887784e9ae"}]}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:45.404962 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.network.neutron [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] validate_networks() for [('d0b894fb-ca2e-4f02-9d2e-0b887784e9ae', None, None, None, None, None)] {{(pid=117033) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:31:45.803479 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bce9d422-e44f-43f3-8322-2cc6a4ceb292 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:45.804554 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-bce9d422-e44f-43f3-8322-2cc6a4ceb292 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 4473a2d0-b3cc-401b-b460-7c00c66893a0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:45.811516 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bce9d422-e44f-43f3-8322-2cc6a4ceb292 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:45.812241 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bce9d422-e44f-43f3-8322-2cc6a4ceb292 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:45.813132 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bce9d422-e44f-43f3-8322-2cc6a4ceb292 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:45.813599 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bce9d422-e44f-43f3-8322-2cc6a4ceb292 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:45.827337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Flavor limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:31:45.827913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Image limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:31:45.828014 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Flavor pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:31:45.828384 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Image pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:31:45.829577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:31:45.837200 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-bce9d422-e44f-43f3-8322-2cc6a4ceb292 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] HTTP exception thrown: Instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 could not be found. May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bce9d422-e44f-43f3-8322-2cc6a4ceb292 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Request method failure captured: May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 HTTP/1.1 May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJf7cd7GDKD--ciqHRq6mwpqDN3h9WRQb3Nc7UnOPo5U2WWp_HyVseZh-Z25QJN0hWRsF1_rRoMji4tz5UYqyzyZD9uv_aEy-DLscIeYW26RnR5edf_QFqZ2j-8nWp_I7Woej_Jl3fU2TVCdYMFK88Cwyxa_cQIHDAAuA7M0Y3pC4Zw May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: d28d5139952d450fa3b7da38a62d7a03 May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:31:45.839320 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:31:45.841423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:31:45.841423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:31:45.841423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: d28d5139952d450fa3b7da38a62d7a03 May 09 04:31:45.841423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:31:45.841423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-ServerRescueNegativeTestJSON-1341609376-project May 09 04:31:45.841423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:31:45.841423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:31:45.841423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 87b7c3ec77d4493dac92bb61d0b376be May 09 04:31:45.841423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1341609376-project May 09 04:31:45.841423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:31:45.841423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 could not be found. May 09 04:31:45.841423 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '4473a2d0-b3cc-401b-b460-7c00c66893a0'} May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 could not be found. May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:31:45.842119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 could not be found. May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 could not be found. May 09 04:31:45.843227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:45.844245 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:45.844245 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:45.844437 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:45.845597 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:45.846481 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bce9d422-e44f-43f3-8322-2cc6a4ceb292 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Returning 404 to user: Instance 4473a2d0-b3cc-401b-b460-7c00c66893a0 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:31:45.847391 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bce9d422-e44f-43f3-8322-2cc6a4ceb292 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0" status: 404 len: 111 microversion: 2.1 time: 0.048674 May 09 04:31:45.851671 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 379/779] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:45 2022] GET /compute/v2.1/servers/4473a2d0-b3cc-401b-b460-7c00c66893a0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:31:45.854882 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-207d62a8-4f9e-44c5-9a81-d6a9410d660f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:45.855556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-207d62a8-4f9e-44c5-9a81-d6a9410d660f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:45.861649 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-207d62a8-4f9e-44c5-9a81-d6a9410d660f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:45.862162 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-207d62a8-4f9e-44c5-9a81-d6a9410d660f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:45.863173 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-207d62a8-4f9e-44c5-9a81-d6a9410d660f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:45.863667 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-207d62a8-4f9e-44c5-9a81-d6a9410d660f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:45.871188 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Getting quotas for project b6223852af9c4361b99a24e7a49a7734. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:31:45.875403 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Getting quotas for user cb34feb512764ec5b9ca25c30c3d7159 and project b6223852af9c4361b99a24e7a49a7734. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:31:45.898296 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-207d62a8-4f9e-44c5-9a81-d6a9410d660f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:45.898822 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-207d62a8-4f9e-44c5-9a81-d6a9410d660f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:45.899378 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-207d62a8-4f9e-44c5-9a81-d6a9410d660f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lazy-loading 'fault' on Instance uuid b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:31:45.937478 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Going to run 1 instances... {{(pid=117033) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:31:45.939721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='009defab-9544-4bb4-9e68-bcc76ec37ad1',volume_size=None,volume_type=None)] {{(pid=117033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:31:45.944669 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-207d62a8-4f9e-44c5-9a81-d6a9410d660f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25e4c84bd2174040a20fa9c60ddb6b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2a64ab3bc1448b8a934e2d103bb161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:45.952695 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-207d62a8-4f9e-44c5-9a81-d6a9410d660f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 200 len: 1348 microversion: 2.1 time: 0.103065 May 09 04:31:45.953255 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 380/780] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:45 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 1348 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:45.958012 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5df85631-fe33-44d2-ac01-b15d4126e11e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '.version_select at 0x7fbfd4354f70>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:45.976886 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5df85631-fe33-44d2-ac01-b15d4126e11e tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-508069349" status: 202 len: 0 microversion: 2.1 time: 0.022609 May 09 04:31:45.977465 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 381/781] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 9 04:31:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-508069349 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:31:46.083527 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8ff7efdf-109c-4504-a4cc-0482135acb18 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.814574 May 09 04:31:46.089634 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 401/782] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:31:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:31:46.094805 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-51f14c32-b073-4315-8b3b-7f838bb3c59b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:46.095416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-51f14c32-b073-4315-8b3b-7f838bb3c59b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:46.178898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-51f14c32-b073-4315-8b3b-7f838bb3c59b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:46.190572 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-51f14c32-b073-4315-8b3b-7f838bb3c59b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1093 microversion: 2.1 time: 0.099386 May 09 04:31:46.191338 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 382/783] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:46 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1093 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:46.194791 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f97b614a-7d5a-4c4f-a011-147d3c60c308 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:46.195531 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f97b614a-7d5a-4c4f-a011-147d3c60c308 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:46.205758 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f97b614a-7d5a-4c4f-a011-147d3c60c308 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:46.206317 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f97b614a-7d5a-4c4f-a011-147d3c60c308 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:46.207185 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f97b614a-7d5a-4c4f-a011-147d3c60c308 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:46.207748 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f97b614a-7d5a-4c4f-a011-147d3c60c308 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:46.568634 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-23c97ded-4d89-4ece-8c55-6672fa957a77 req-ae71122e-cd9e-46db-a4d4-afd7e090de04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52cecb3-2634-4f9e-a9df-1ae4595bb3e1", "name": "network-vif-deleted", "tag": "675e6f12-2f41-46e3-b8d5-09ed37ae4a6f"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:46.581441 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-23c97ded-4d89-4ece-8c55-6672fa957a77 req-ae71122e-cd9e-46db-a4d4-afd7e090de04 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:46.582785 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-23c97ded-4d89-4ece-8c55-6672fa957a77 req-ae71122e-cd9e-46db-a4d4-afd7e090de04 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:46.600217 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-23c97ded-4d89-4ece-8c55-6672fa957a77 req-ae71122e-cd9e-46db-a4d4-afd7e090de04 service nova] Creating event network-vif-deleted:675e6f12-2f41-46e3-b8d5-09ed37ae4a6f for instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 on hv-cinder-83800 May 09 04:31:46.608248 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f97b614a-7d5a-4c4f-a011-147d3c60c308 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:46.610200 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-23c97ded-4d89-4ece-8c55-6672fa957a77 req-ae71122e-cd9e-46db-a4d4-afd7e090de04 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044489 May 09 04:31:46.611377 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 383/784] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:31:46.615945 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f97b614a-7d5a-4c4f-a011-147d3c60c308 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.425179 May 09 04:31:46.620296 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 402/785] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:46 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:46.971142 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-691e8512-8433-41e1-b8f9-0b122f9cf79f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:46.972091 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-691e8512-8433-41e1-b8f9-0b122f9cf79f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] [instance: b52cecb3-2634-4f9e-a9df-1ae4595bb3e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:46.979249 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-691e8512-8433-41e1-b8f9-0b122f9cf79f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:46.979700 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-691e8512-8433-41e1-b8f9-0b122f9cf79f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:46.980512 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-691e8512-8433-41e1-b8f9-0b122f9cf79f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:46.980945 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-691e8512-8433-41e1-b8f9-0b122f9cf79f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:46.994497 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-691e8512-8433-41e1-b8f9-0b122f9cf79f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] HTTP exception thrown: Instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 could not be found. May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-691e8512-8433-41e1-b8f9-0b122f9cf79f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Request method failure captured: May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 HTTP/1.1 May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJhMMjHQQ37dp6oN8VDYHU53ZYw1AqMR-TQ2h6Q6fbad2FafRPjwPqFge-yckPJip6NxkNBiql3ALMPL0z1BJKYg3BcoVVHehuuLPer3fmvzREQf7RESeigRgsVFaAmMmR1xe1lPQACYpQHQALRVpwDijILOdYRRGN-wtuc8TBQDlTo May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: cf2a64ab3bc1448b8a934e2d103bb161 May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-TestMinimumBasicScenario-890725566 May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:31:46.996130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:31:46.997569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cf2a64ab3bc1448b8a934e2d103bb161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf2a64ab3bc1448b8a934e2d103bb161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf2a64ab3bc1448b8a934e2d103bb161"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cf2a64ab3bc1448b8a934e2d103bb161"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:31:46.997569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-TestMinimumBasicScenario-890725566 May 09 04:31:46.997569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: cf2a64ab3bc1448b8a934e2d103bb161 May 09 04:31:46.997569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-TestMinimumBasicScenario-890725566 May 09 04:31:46.997569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-TestMinimumBasicScenario-890725566-project May 09 04:31:46.997569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:31:46.997569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:31:46.997569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 25e4c84bd2174040a20fa9c60ddb6b55 May 09 04:31:46.997569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-TestMinimumBasicScenario-890725566-project May 09 04:31:46.997569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:31:46.997569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 could not be found. May 09 04:31:46.997569 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': 'b52cecb3-2634-4f9e-a9df-1ae4595bb3e1'} May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 could not be found. May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:31:46.998411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 could not be found. May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 could not be found. May 09 04:31:46.999645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:47.000776 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-691e8512-8433-41e1-b8f9-0b122f9cf79f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Returning 404 to user: Instance b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:31:47.000776 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-691e8512-8433-41e1-b8f9-0b122f9cf79f tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1" status: 404 len: 111 microversion: 2.1 time: 0.030588 May 09 04:31:47.000776 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 384/786] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:46 2022] GET /compute/v2.1/servers/b52cecb3-2634-4f9e-a9df-1ae4595bb3e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:31:47.006037 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a309d26e-c1f5-457e-84cd-c4606ba5d3ce tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] Calling method '.version_select at 0x7fbfd45258b0>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:47.023872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a309d26e-c1f5-457e-84cd-c4606ba5d3ce tempest-TestMinimumBasicScenario-890725566 tempest-TestMinimumBasicScenario-890725566-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-300254567" status: 202 len: 0 microversion: 2.1 time: 0.021520 May 09 04:31:47.024655 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 403/787] 10.222.0.44 () {58 vars in 1268 bytes} [Mon May 9 04:31:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-300254567 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 04:31:47.208371 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b6497934-d9c0-4baa-85ec-beb63d646e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:47.208980 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b6497934-d9c0-4baa-85ec-beb63d646e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:47.215791 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b6497934-d9c0-4baa-85ec-beb63d646e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:47.216212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b6497934-d9c0-4baa-85ec-beb63d646e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:47.216984 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b6497934-d9c0-4baa-85ec-beb63d646e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:47.217590 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b6497934-d9c0-4baa-85ec-beb63d646e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:47.321524 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b6497934-d9c0-4baa-85ec-beb63d646e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:47.332941 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b6497934-d9c0-4baa-85ec-beb63d646e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1209 microversion: 2.1 time: 0.129247 May 09 04:31:47.333526 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 385/788] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:47 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1209 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:47.634757 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8e24a28c-f872-48a6-aa09-d8f21fab63d1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:47.635833 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8e24a28c-f872-48a6-aa09-d8f21fab63d1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:47.643577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8e24a28c-f872-48a6-aa09-d8f21fab63d1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:47.644974 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8e24a28c-f872-48a6-aa09-d8f21fab63d1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:47.646227 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8e24a28c-f872-48a6-aa09-d8f21fab63d1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:47.646668 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8e24a28c-f872-48a6-aa09-d8f21fab63d1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:47.855600 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-af8d706f-3c18-465d-b451-b17ac714707d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:47.857119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-af8d706f-3c18-465d-b451-b17ac714707d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:47.869280 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af8d706f-3c18-465d-b451-b17ac714707d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:47.870634 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af8d706f-3c18-465d-b451-b17ac714707d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:47.872196 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af8d706f-3c18-465d-b451-b17ac714707d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:47.872953 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af8d706f-3c18-465d-b451-b17ac714707d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:47.912132 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-af8d706f-3c18-465d-b451-b17ac714707d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c/ips" status: 200 len: 152 microversion: 2.20 time: 0.186103 May 09 04:31:47.913539 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 386/789] 10.222.0.44 () {60 vars in 1288 bytes} [Mon May 9 04:31:47 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c/ips => generated 152 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 04:31:47.965367 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8e24a28c-f872-48a6-aa09-d8f21fab63d1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:47.974725 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8e24a28c-f872-48a6-aa09-d8f21fab63d1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.344542 May 09 04:31:47.986850 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 404/790] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:47 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:48.352513 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-03cf6481-4861-45b1-a629-37929e7f1759 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:48.353248 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-03cf6481-4861-45b1-a629-37929e7f1759 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:48.368139 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-03cf6481-4861-45b1-a629-37929e7f1759 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:48.368825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-03cf6481-4861-45b1-a629-37929e7f1759 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:48.369700 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-03cf6481-4861-45b1-a629-37929e7f1759 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:48.370299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-03cf6481-4861-45b1-a629-37929e7f1759 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:48.635797 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-03cf6481-4861-45b1-a629-37929e7f1759 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:48.643237 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-03cf6481-4861-45b1-a629-37929e7f1759 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.296517 May 09 04:31:48.644145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 387/791] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:48 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:48.994051 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-2f3fa6c9-71fd-4bf7-8a91-aa048a0f65a1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:48.995273 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-2f3fa6c9-71fd-4bf7-8a91-aa048a0f65a1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:49.002071 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2f3fa6c9-71fd-4bf7-8a91-aa048a0f65a1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:49.002757 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2f3fa6c9-71fd-4bf7-8a91-aa048a0f65a1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:49.003740 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2f3fa6c9-71fd-4bf7-8a91-aa048a0f65a1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:49.006179 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2f3fa6c9-71fd-4bf7-8a91-aa048a0f65a1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:49.022319 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-60ff731b-6f57-42f2-882c-5f930abeacb2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:49.022875 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-60ff731b-6f57-42f2-882c-5f930abeacb2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:49.032050 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-60ff731b-6f57-42f2-882c-5f930abeacb2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:49.032313 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-60ff731b-6f57-42f2-882c-5f930abeacb2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:49.033092 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-60ff731b-6f57-42f2-882c-5f930abeacb2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:49.033545 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-60ff731b-6f57-42f2-882c-5f930abeacb2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:49.101620 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-60ff731b-6f57-42f2-882c-5f930abeacb2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:31:49.212039 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-60ff731b-6f57-42f2-882c-5f930abeacb2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 204 len: 0 microversion: 2.1 time: 0.193050 May 09 04:31:49.214529 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 388/792] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:31:49 2022] DELETE /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 04:31:49.224918 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-8b88239d-5816-4d9f-bd5f-03ed99559e9f req-75903e61-ad77-4284-9fdf-fbc0aacf10d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0064c5db-f056-49f6-a8ba-54c3f60c41ec", "tag": "e05ee7be-8781-44a0-8ae2-fb665919b80b"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:49.234380 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-8b88239d-5816-4d9f-bd5f-03ed99559e9f req-75903e61-ad77-4284-9fdf-fbc0aacf10d9 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:49.234821 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-8b88239d-5816-4d9f-bd5f-03ed99559e9f req-75903e61-ad77-4284-9fdf-fbc0aacf10d9 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:49.247114 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-8b88239d-5816-4d9f-bd5f-03ed99559e9f req-75903e61-ad77-4284-9fdf-fbc0aacf10d9 service nova] Creating event network-changed:e05ee7be-8781-44a0-8ae2-fb665919b80b for instance 0064c5db-f056-49f6-a8ba-54c3f60c41ec on hv-cinder-83800 May 09 04:31:49.251382 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-2f3fa6c9-71fd-4bf7-8a91-aa048a0f65a1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:49.252629 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-8b88239d-5816-4d9f-bd5f-03ed99559e9f req-75903e61-ad77-4284-9fdf-fbc0aacf10d9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032185 May 09 04:31:49.253576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 389/793] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:49.262461 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-64a6f3ba-4942-4e7a-90fc-94a01c46ba4c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:49.263403 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-64a6f3ba-4942-4e7a-90fc-94a01c46ba4c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:49.265336 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-2f3fa6c9-71fd-4bf7-8a91-aa048a0f65a1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.275740 May 09 04:31:49.266411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 405/794] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:48 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:49.277542 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-64a6f3ba-4942-4e7a-90fc-94a01c46ba4c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:49.277997 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-64a6f3ba-4942-4e7a-90fc-94a01c46ba4c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:49.278835 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-64a6f3ba-4942-4e7a-90fc-94a01c46ba4c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:49.279271 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-64a6f3ba-4942-4e7a-90fc-94a01c46ba4c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:49.458224 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-64a6f3ba-4942-4e7a-90fc-94a01c46ba4c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:49.466637 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-64a6f3ba-4942-4e7a-90fc-94a01c46ba4c tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1507 microversion: 2.1 time: 0.211595 May 09 04:31:49.467303 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 390/795] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:49 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:49.661167 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a6f8533f-ee9a-4d54-bf0c-3135038ac2cb tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:49.661826 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a6f8533f-ee9a-4d54-bf0c-3135038ac2cb tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:49.668720 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6f8533f-ee9a-4d54-bf0c-3135038ac2cb tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:49.669287 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6f8533f-ee9a-4d54-bf0c-3135038ac2cb tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:49.670073 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6f8533f-ee9a-4d54-bf0c-3135038ac2cb tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:49.670516 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a6f8533f-ee9a-4d54-bf0c-3135038ac2cb tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:49.818104 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a6f8533f-ee9a-4d54-bf0c-3135038ac2cb tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:49.825828 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a6f8533f-ee9a-4d54-bf0c-3135038ac2cb tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.168619 May 09 04:31:49.826416 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 406/796] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:49 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:50.070270 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-135b9498-2047-4f75-9cc5-01ce72d7dd69 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:50.071093 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-135b9498-2047-4f75-9cc5-01ce72d7dd69 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:50.079821 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-135b9498-2047-4f75-9cc5-01ce72d7dd69 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:50.080333 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-135b9498-2047-4f75-9cc5-01ce72d7dd69 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:50.081095 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-135b9498-2047-4f75-9cc5-01ce72d7dd69 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:50.081517 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-135b9498-2047-4f75-9cc5-01ce72d7dd69 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:50.108234 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-135b9498-2047-4f75-9cc5-01ce72d7dd69 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lazy-loading 'flavor' on Instance uuid 96f5900f-cb8a-485d-866b-580b188cc09c {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:31:50.283612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-24f5d128-ba3a-4668-bc2b-538824e7bd25 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:50.284263 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-24f5d128-ba3a-4668-bc2b-538824e7bd25 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:50.291567 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-24f5d128-ba3a-4668-bc2b-538824e7bd25 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:50.292049 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-24f5d128-ba3a-4668-bc2b-538824e7bd25 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:50.292813 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-24f5d128-ba3a-4668-bc2b-538824e7bd25 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:50.293447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-24f5d128-ba3a-4668-bc2b-538824e7bd25 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:50.399179 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-135b9498-2047-4f75-9cc5-01ce72d7dd69 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "POST /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c/action" status: 202 len: 0 microversion: 2.20 time: 0.332952 May 09 04:31:50.401015 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 391/797] 10.222.0.44 () {62 vars in 1318 bytes} [Mon May 9 04:31:50 2022] POST /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 09 04:31:50.409459 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4ef7370b-ab7d-4825-bbc6-884468efeaa6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:50.410377 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4ef7370b-ab7d-4825-bbc6-884468efeaa6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:50.417899 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4ef7370b-ab7d-4825-bbc6-884468efeaa6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:50.418560 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4ef7370b-ab7d-4825-bbc6-884468efeaa6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:50.419392 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4ef7370b-ab7d-4825-bbc6-884468efeaa6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:50.420031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4ef7370b-ab7d-4825-bbc6-884468efeaa6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:50.441022 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-24f5d128-ba3a-4668-bc2b-538824e7bd25 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:50.449512 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-24f5d128-ba3a-4668-bc2b-538824e7bd25 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.169699 May 09 04:31:50.450090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 407/798] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:50 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:50.484244 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5ad9cbdc-9378-45e2-8839-f52deca79fda tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:50.485135 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5ad9cbdc-9378-45e2-8839-f52deca79fda tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:50.491370 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5ad9cbdc-9378-45e2-8839-f52deca79fda tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:50.491761 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5ad9cbdc-9378-45e2-8839-f52deca79fda tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:50.492594 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5ad9cbdc-9378-45e2-8839-f52deca79fda tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:50.493225 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5ad9cbdc-9378-45e2-8839-f52deca79fda tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:50.632754 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5ad9cbdc-9378-45e2-8839-f52deca79fda tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:50.633561 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4ef7370b-ab7d-4825-bbc6-884468efeaa6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:50.640709 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5ad9cbdc-9378-45e2-8839-f52deca79fda tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1507 microversion: 2.1 time: 0.160604 May 09 04:31:50.641688 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 408/799] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:50 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:50.645580 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4ef7370b-ab7d-4825-bbc6-884468efeaa6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:50.647338 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4ef7370b-ab7d-4825-bbc6-884468efeaa6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:50.648638 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4ef7370b-ab7d-4825-bbc6-884468efeaa6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.243763 May 09 04:31:50.649291 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 392/800] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:31:50 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:31:50.843239 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1702c8f6-89a4-4f87-ad6d-9438db966534 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:50.843854 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1702c8f6-89a4-4f87-ad6d-9438db966534 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:50.851285 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1702c8f6-89a4-4f87-ad6d-9438db966534 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:50.851932 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1702c8f6-89a4-4f87-ad6d-9438db966534 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:50.852856 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1702c8f6-89a4-4f87-ad6d-9438db966534 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:50.853589 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1702c8f6-89a4-4f87-ad6d-9438db966534 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:51.097924 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1702c8f6-89a4-4f87-ad6d-9438db966534 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:51.106167 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1702c8f6-89a4-4f87-ad6d-9438db966534 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.266541 May 09 04:31:51.107374 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 409/801] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:50 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:51.467714 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-99c485a3-036a-4fba-b280-8ff36ee4dda5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:51.468495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-99c485a3-036a-4fba-b280-8ff36ee4dda5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:51.475609 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-99c485a3-036a-4fba-b280-8ff36ee4dda5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:51.476219 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-99c485a3-036a-4fba-b280-8ff36ee4dda5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:51.476947 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-99c485a3-036a-4fba-b280-8ff36ee4dda5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:51.477387 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-99c485a3-036a-4fba-b280-8ff36ee4dda5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:51.658974 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-09fde693-fbaa-4daf-8e34-3651c62ab1f6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:51.659802 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-09fde693-fbaa-4daf-8e34-3651c62ab1f6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:51.669333 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-09fde693-fbaa-4daf-8e34-3651c62ab1f6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:51.669979 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-09fde693-fbaa-4daf-8e34-3651c62ab1f6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:51.671639 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-09fde693-fbaa-4daf-8e34-3651c62ab1f6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:51.672632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-09fde693-fbaa-4daf-8e34-3651c62ab1f6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:51.749784 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-99c485a3-036a-4fba-b280-8ff36ee4dda5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:51.764661 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-99c485a3-036a-4fba-b280-8ff36ee4dda5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.301037 May 09 04:31:51.765251 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 393/802] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:51 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:51.770314 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4704b585-21e1-4a55-9270-0380c620def8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:51.770915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4704b585-21e1-4a55-9270-0380c620def8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:51.778772 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4704b585-21e1-4a55-9270-0380c620def8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:51.779224 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4704b585-21e1-4a55-9270-0380c620def8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:51.780204 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4704b585-21e1-4a55-9270-0380c620def8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:51.780706 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4704b585-21e1-4a55-9270-0380c620def8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:51.868269 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-09fde693-fbaa-4daf-8e34-3651c62ab1f6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:51.875972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-09fde693-fbaa-4daf-8e34-3651c62ab1f6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1507 microversion: 2.1 time: 0.221005 May 09 04:31:51.876547 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 410/803] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:51 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1507 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:51.999915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4704b585-21e1-4a55-9270-0380c620def8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:52.007666 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4704b585-21e1-4a55-9270-0380c620def8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:52.009241 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4704b585-21e1-4a55-9270-0380c620def8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:52.010383 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4704b585-21e1-4a55-9270-0380c620def8 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.243692 May 09 04:31:52.010971 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 394/804] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:31:51 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:31:52.123435 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b0aee8c0-25fe-4c90-80e0-49814746b353 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:52.124188 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b0aee8c0-25fe-4c90-80e0-49814746b353 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:52.130196 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b0aee8c0-25fe-4c90-80e0-49814746b353 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:52.130713 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b0aee8c0-25fe-4c90-80e0-49814746b353 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:52.131549 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b0aee8c0-25fe-4c90-80e0-49814746b353 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:52.132116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b0aee8c0-25fe-4c90-80e0-49814746b353 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:52.264509 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b0aee8c0-25fe-4c90-80e0-49814746b353 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:52.272383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b0aee8c0-25fe-4c90-80e0-49814746b353 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.152423 May 09 04:31:52.273396 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 411/805] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:52 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:52.781404 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-37b7dfde-c382-4496-9665-9e39c9847d30 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:52.782011 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-37b7dfde-c382-4496-9665-9e39c9847d30 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:52.788473 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-37b7dfde-c382-4496-9665-9e39c9847d30 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:52.788917 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-37b7dfde-c382-4496-9665-9e39c9847d30 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:52.789675 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-37b7dfde-c382-4496-9665-9e39c9847d30 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:52.790107 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-37b7dfde-c382-4496-9665-9e39c9847d30 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:52.894612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3ec1a39e-70ba-49a7-8d67-d96edf871322 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:52.895233 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-3ec1a39e-70ba-49a7-8d67-d96edf871322 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:52.901402 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3ec1a39e-70ba-49a7-8d67-d96edf871322 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:52.901852 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3ec1a39e-70ba-49a7-8d67-d96edf871322 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:52.902632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3ec1a39e-70ba-49a7-8d67-d96edf871322 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:52.903071 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3ec1a39e-70ba-49a7-8d67-d96edf871322 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:53.038456 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3ec1a39e-70ba-49a7-8d67-d96edf871322 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:53.047190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-3ec1a39e-70ba-49a7-8d67-d96edf871322 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1507 microversion: 2.1 time: 0.156734 May 09 04:31:53.048535 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 412/806] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:52 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:53.053176 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3c54a9d7-61d8-4d53-8941-27558f8472ad tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:53.054009 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-3c54a9d7-61d8-4d53-8941-27558f8472ad tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:53.060729 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3c54a9d7-61d8-4d53-8941-27558f8472ad tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:53.061186 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3c54a9d7-61d8-4d53-8941-27558f8472ad tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:53.061964 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3c54a9d7-61d8-4d53-8941-27558f8472ad tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:53.062438 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3c54a9d7-61d8-4d53-8941-27558f8472ad tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:53.195264 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-37b7dfde-c382-4496-9665-9e39c9847d30 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:53.206675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3c54a9d7-61d8-4d53-8941-27558f8472ad tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:53.208611 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-37b7dfde-c382-4496-9665-9e39c9847d30 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.431207 May 09 04:31:53.218655 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3c54a9d7-61d8-4d53-8941-27558f8472ad tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:53.220134 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 395/807] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:52 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:53.220272 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3c54a9d7-61d8-4d53-8941-27558f8472ad tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:53.221430 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-3c54a9d7-61d8-4d53-8941-27558f8472ad tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.171872 May 09 04:31:53.221983 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 413/808] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:31:53 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:31:53.289435 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3b427b20-5a64-47dc-963c-23fec18f67b0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:53.290863 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3b427b20-5a64-47dc-963c-23fec18f67b0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:53.297625 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b427b20-5a64-47dc-963c-23fec18f67b0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:53.298178 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b427b20-5a64-47dc-963c-23fec18f67b0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:53.299016 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b427b20-5a64-47dc-963c-23fec18f67b0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:53.299524 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b427b20-5a64-47dc-963c-23fec18f67b0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:53.602139 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3b427b20-5a64-47dc-963c-23fec18f67b0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:53.611947 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3b427b20-5a64-47dc-963c-23fec18f67b0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.326398 May 09 04:31:53.612690 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 396/809] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:53 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:53.863559 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-25ecca8b-603d-44a2-821b-54e389f4d3d8 req-2962a68d-8efe-467e-9818-cf3f7dfa2b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc9d45a-d1d9-4a28-8af9-4b6e14898436", "name": "network-vif-deleted", "tag": "e798f1fa-3df7-4ec0-be2e-bf5db59b8036"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:53.876255 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-25ecca8b-603d-44a2-821b-54e389f4d3d8 req-2962a68d-8efe-467e-9818-cf3f7dfa2b2a service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:53.876825 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-25ecca8b-603d-44a2-821b-54e389f4d3d8 req-2962a68d-8efe-467e-9818-cf3f7dfa2b2a service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:53.892744 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-25ecca8b-603d-44a2-821b-54e389f4d3d8 req-2962a68d-8efe-467e-9818-cf3f7dfa2b2a service nova] Creating event network-vif-deleted:e798f1fa-3df7-4ec0-be2e-bf5db59b8036 for instance 7fc9d45a-d1d9-4a28-8af9-4b6e14898436 on hv-cinder-83800 May 09 04:31:53.901675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-25ecca8b-603d-44a2-821b-54e389f4d3d8 req-2962a68d-8efe-467e-9818-cf3f7dfa2b2a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042047 May 09 04:31:53.902604 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 414/810] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:54.065937 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6a525727-c940-43f3-866c-a9e8e968e3b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:54.067179 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6a525727-c940-43f3-866c-a9e8e968e3b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:54.077284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a525727-c940-43f3-866c-a9e8e968e3b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:54.077986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a525727-c940-43f3-866c-a9e8e968e3b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:54.078943 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a525727-c940-43f3-866c-a9e8e968e3b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:54.079383 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a525727-c940-43f3-866c-a9e8e968e3b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:54.113338 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a525727-c940-43f3-866c-a9e8e968e3b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:54.113787 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a525727-c940-43f3-866c-a9e8e968e3b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:54.114240 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-6a525727-c940-43f3-866c-a9e8e968e3b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lazy-loading 'fault' on Instance uuid 7fc9d45a-d1d9-4a28-8af9-4b6e14898436 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:31:54.168692 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6a525727-c940-43f3-866c-a9e8e968e3b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:54.176651 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6a525727-c940-43f3-866c-a9e8e968e3b2 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 200 len: 1311 microversion: 2.1 time: 0.115335 May 09 04:31:54.180256 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 397/811] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:54 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 1311 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:54.227073 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-9cecdab1-59ed-438f-bfe6-b9b05341a3f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:54.228401 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-9cecdab1-59ed-438f-bfe6-b9b05341a3f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:54.234991 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9cecdab1-59ed-438f-bfe6-b9b05341a3f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:54.235753 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9cecdab1-59ed-438f-bfe6-b9b05341a3f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:54.236552 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9cecdab1-59ed-438f-bfe6-b9b05341a3f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:54.236993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9cecdab1-59ed-438f-bfe6-b9b05341a3f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:54.240840 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-02f13d8d-d397-4e24-b7da-5d1261897f1c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:54.241586 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-02f13d8d-d397-4e24-b7da-5d1261897f1c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:54.248024 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-02f13d8d-d397-4e24-b7da-5d1261897f1c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:54.248550 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-02f13d8d-d397-4e24-b7da-5d1261897f1c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:54.249395 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-02f13d8d-d397-4e24-b7da-5d1261897f1c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:54.250069 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-02f13d8d-d397-4e24-b7da-5d1261897f1c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:54.421777 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9cecdab1-59ed-438f-bfe6-b9b05341a3f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:54.432696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-9cecdab1-59ed-438f-bfe6-b9b05341a3f1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.209754 May 09 04:31:54.433295 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 415/812] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:54 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:54.583686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-02f13d8d-d397-4e24-b7da-5d1261897f1c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:54.591875 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-02f13d8d-d397-4e24-b7da-5d1261897f1c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:54.593402 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-02f13d8d-d397-4e24-b7da-5d1261897f1c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:54.594551 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-02f13d8d-d397-4e24-b7da-5d1261897f1c tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.358056 May 09 04:31:54.595117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 398/813] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:31:54 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:31:54.629657 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d103f2c4-3f39-42fe-8df1-1b996f3bb29b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:54.630187 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d103f2c4-3f39-42fe-8df1-1b996f3bb29b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:54.636936 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d103f2c4-3f39-42fe-8df1-1b996f3bb29b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:54.637493 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d103f2c4-3f39-42fe-8df1-1b996f3bb29b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:54.638400 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d103f2c4-3f39-42fe-8df1-1b996f3bb29b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:54.638983 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d103f2c4-3f39-42fe-8df1-1b996f3bb29b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:54.795146 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d103f2c4-3f39-42fe-8df1-1b996f3bb29b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:54.804347 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d103f2c4-3f39-42fe-8df1-1b996f3bb29b tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.178484 May 09 04:31:54.805024 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 416/814] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:54 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:55.193386 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4c751314-9166-4da0-9c0a-1a71c28f827d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:55.194696 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4c751314-9166-4da0-9c0a-1a71c28f827d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 7fc9d45a-d1d9-4a28-8af9-4b6e14898436] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:55.201292 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c751314-9166-4da0-9c0a-1a71c28f827d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:55.201657 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c751314-9166-4da0-9c0a-1a71c28f827d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:55.202430 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c751314-9166-4da0-9c0a-1a71c28f827d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:55.202866 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c751314-9166-4da0-9c0a-1a71c28f827d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:55.217508 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-4c751314-9166-4da0-9c0a-1a71c28f827d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] HTTP exception thrown: Instance 7fc9d45a-d1d9-4a28-8af9-4b6e14898436 could not be found. May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4c751314-9166-4da0-9c0a-1a71c28f827d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Request method failure captured: May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 HTTP/1.1 May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJf7cd7GDKD--ciqHRq6mwpqDN3h9WRQb3Nc7UnOPo5U2WWp_HyVseZh-Z25QJN0hWRsF1_rRoMji4tz5UYqyzyZD9uv_aEy-DLscIeYW26RnR5edf_QFqZ2j-8nWp_I7Woej_Jl3fU2TVCdYMFK88Cwyxa_cQIHDAAuA7M0Y3pC4Zw May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: d28d5139952d450fa3b7da38a62d7a03 May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:31:55.219336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:31:55.220977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:31:55.220977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:31:55.220977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: d28d5139952d450fa3b7da38a62d7a03 May 09 04:31:55.220977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:31:55.220977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-ServerRescueNegativeTestJSON-1341609376-project May 09 04:31:55.220977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:31:55.220977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:31:55.220977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 87b7c3ec77d4493dac92bb61d0b376be May 09 04:31:55.220977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1341609376-project May 09 04:31:55.220977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:31:55.220977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 7fc9d45a-d1d9-4a28-8af9-4b6e14898436 could not be found. May 09 04:31:55.220977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '7fc9d45a-d1d9-4a28-8af9-4b6e14898436'} May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc9d45a-d1d9-4a28-8af9-4b6e14898436 could not be found. May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:31:55.221764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc9d45a-d1d9-4a28-8af9-4b6e14898436 could not be found. May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc9d45a-d1d9-4a28-8af9-4b6e14898436 could not be found. May 09 04:31:55.222874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:31:55.223872 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4c751314-9166-4da0-9c0a-1a71c28f827d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Returning 404 to user: Instance 7fc9d45a-d1d9-4a28-8af9-4b6e14898436 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:31:55.223872 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4c751314-9166-4da0-9c0a-1a71c28f827d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436" status: 404 len: 111 microversion: 2.1 time: 0.031314 May 09 04:31:55.223872 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 399/815] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:55 2022] GET /compute/v2.1/servers/7fc9d45a-d1d9-4a28-8af9-4b6e14898436 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:31:55.231156 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-94baad8a-1149-4cd1-91ad-a06ec81a1eb0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:55.231881 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-94baad8a-1149-4cd1-91ad-a06ec81a1eb0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:55.238717 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-94baad8a-1149-4cd1-91ad-a06ec81a1eb0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:55.239591 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-94baad8a-1149-4cd1-91ad-a06ec81a1eb0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:55.240547 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-94baad8a-1149-4cd1-91ad-a06ec81a1eb0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:55.241101 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-94baad8a-1149-4cd1-91ad-a06ec81a1eb0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:55.276400 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-94baad8a-1149-4cd1-91ad-a06ec81a1eb0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Going to try to terminate instance {{(pid=117033) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:31:55.369445 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-94baad8a-1149-4cd1-91ad-a06ec81a1eb0 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 204 len: 0 microversion: 2.1 time: 0.142604 May 09 04:31:55.370133 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 417/816] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:31:55 2022] DELETE /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:31:55.377984 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ad63b169-616c-41ec-aca4-652568e86ffb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:55.378600 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ad63b169-616c-41ec-aca4-652568e86ffb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:55.384979 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ad63b169-616c-41ec-aca4-652568e86ffb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:55.385511 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ad63b169-616c-41ec-aca4-652568e86ffb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:55.386474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ad63b169-616c-41ec-aca4-652568e86ffb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:55.386915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ad63b169-616c-41ec-aca4-652568e86ffb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:55.450534 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-62f5705b-1e69-413c-b98d-12a8976d08e1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:55.451248 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-62f5705b-1e69-413c-b98d-12a8976d08e1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:55.457249 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-62f5705b-1e69-413c-b98d-12a8976d08e1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:55.457637 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-62f5705b-1e69-413c-b98d-12a8976d08e1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:55.458412 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-62f5705b-1e69-413c-b98d-12a8976d08e1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:55.458858 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-62f5705b-1e69-413c-b98d-12a8976d08e1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:55.581293 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ad63b169-616c-41ec-aca4-652568e86ffb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:55.590559 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ad63b169-616c-41ec-aca4-652568e86ffb tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.216131 May 09 04:31:55.591471 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 400/817] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:55 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:55.602096 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-62f5705b-1e69-413c-b98d-12a8976d08e1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:55.614693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-62f5705b-1e69-413c-b98d-12a8976d08e1 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.168544 May 09 04:31:55.615606 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 418/818] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:55 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:55.618971 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1c8cd7e9-3df1-4ff2-981e-71687a2c4fa7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:55.620498 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1c8cd7e9-3df1-4ff2-981e-71687a2c4fa7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:55.633724 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1c8cd7e9-3df1-4ff2-981e-71687a2c4fa7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:55.634326 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1c8cd7e9-3df1-4ff2-981e-71687a2c4fa7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:55.635101 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1c8cd7e9-3df1-4ff2-981e-71687a2c4fa7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:55.635532 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1c8cd7e9-3df1-4ff2-981e-71687a2c4fa7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:55.822589 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4d125190-dc0d-4dd4-83df-e3d9502e5a6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:55.827781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-4d125190-dc0d-4dd4-83df-e3d9502e5a6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:55.834593 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4d125190-dc0d-4dd4-83df-e3d9502e5a6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:55.835053 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4d125190-dc0d-4dd4-83df-e3d9502e5a6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:55.835833 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4d125190-dc0d-4dd4-83df-e3d9502e5a6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:55.836299 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4d125190-dc0d-4dd4-83df-e3d9502e5a6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:55.914477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1c8cd7e9-3df1-4ff2-981e-71687a2c4fa7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:55.926225 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1c8cd7e9-3df1-4ff2-981e-71687a2c4fa7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:55.927915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1c8cd7e9-3df1-4ff2-981e-71687a2c4fa7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:55.929235 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1c8cd7e9-3df1-4ff2-981e-71687a2c4fa7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.319445 May 09 04:31:55.929907 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 401/819] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:31:55 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:31:55.980094 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4d125190-dc0d-4dd4-83df-e3d9502e5a6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:55.987554 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-4d125190-dc0d-4dd4-83df-e3d9502e5a6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.169405 May 09 04:31:55.988152 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 419/820] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:55 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:56.517359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-a373fb42-2ff9-4669-87dc-83d35a4870c0 req-03af9bff-7116-4449-9228-30ef93761a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a541a008-c541-407b-8868-a2b9d98ed15d", "name": "network-vif-plugged", "status": "completed", "tag": "8b3c8f68-461e-4b7f-843a-747af41739b1"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:56.526903 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-a373fb42-2ff9-4669-87dc-83d35a4870c0 req-03af9bff-7116-4449-9228-30ef93761a26 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:56.527610 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-a373fb42-2ff9-4669-87dc-83d35a4870c0 req-03af9bff-7116-4449-9228-30ef93761a26 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:56.539095 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-a373fb42-2ff9-4669-87dc-83d35a4870c0 req-03af9bff-7116-4449-9228-30ef93761a26 service nova] Creating event network-vif-plugged:8b3c8f68-461e-4b7f-843a-747af41739b1 for instance a541a008-c541-407b-8868-a2b9d98ed15d on hv-cinder-83800 May 09 04:31:56.545275 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-a373fb42-2ff9-4669-87dc-83d35a4870c0 req-03af9bff-7116-4449-9228-30ef93761a26 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031674 May 09 04:31:56.546018 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 402/821] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:31:56.607883 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f778d6fb-7865-46f8-b29a-59119218b5c3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:56.609143 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f778d6fb-7865-46f8-b29a-59119218b5c3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:56.615763 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f778d6fb-7865-46f8-b29a-59119218b5c3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:56.616245 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f778d6fb-7865-46f8-b29a-59119218b5c3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:56.617035 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f778d6fb-7865-46f8-b29a-59119218b5c3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:56.617461 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f778d6fb-7865-46f8-b29a-59119218b5c3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:56.633022 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f14c193f-5e55-477c-a7c4-9abee74dd5f4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:56.633718 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f14c193f-5e55-477c-a7c4-9abee74dd5f4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:56.642852 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f14c193f-5e55-477c-a7c4-9abee74dd5f4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:56.644013 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f14c193f-5e55-477c-a7c4-9abee74dd5f4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:56.645091 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f14c193f-5e55-477c-a7c4-9abee74dd5f4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:56.645750 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f14c193f-5e55-477c-a7c4-9abee74dd5f4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:56.778961 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f778d6fb-7865-46f8-b29a-59119218b5c3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:56.789395 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f778d6fb-7865-46f8-b29a-59119218b5c3 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.185510 May 09 04:31:56.790975 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 420/822] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:56 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:56.889126 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f14c193f-5e55-477c-a7c4-9abee74dd5f4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:56.896329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f14c193f-5e55-477c-a7c4-9abee74dd5f4 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.267647 May 09 04:31:56.896888 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 403/823] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:56 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:56.949062 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-9e84a6da-3328-4f22-9e43-d89438c1cb28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:56.949741 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-9e84a6da-3328-4f22-9e43-d89438c1cb28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:56.955839 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9e84a6da-3328-4f22-9e43-d89438c1cb28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:56.956324 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9e84a6da-3328-4f22-9e43-d89438c1cb28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:56.957133 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9e84a6da-3328-4f22-9e43-d89438c1cb28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:56.957576 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9e84a6da-3328-4f22-9e43-d89438c1cb28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:57.004748 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7c0c4003-307b-4b45-bf95-014280244953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:57.005468 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7c0c4003-307b-4b45-bf95-014280244953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:57.013166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7c0c4003-307b-4b45-bf95-014280244953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:57.013689 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7c0c4003-307b-4b45-bf95-014280244953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:57.014568 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7c0c4003-307b-4b45-bf95-014280244953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:57.015098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7c0c4003-307b-4b45-bf95-014280244953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:57.094755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9e84a6da-3328-4f22-9e43-d89438c1cb28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:57.102594 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9e84a6da-3328-4f22-9e43-d89438c1cb28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:57.104129 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9e84a6da-3328-4f22-9e43-d89438c1cb28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:57.105297 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-9e84a6da-3328-4f22-9e43-d89438c1cb28 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.160910 May 09 04:31:57.105864 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 421/824] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:31:56 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:31:57.189678 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7c0c4003-307b-4b45-bf95-014280244953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:57.197682 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7c0c4003-307b-4b45-bf95-014280244953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.197060 May 09 04:31:57.198255 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 404/825] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:56 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:57.808539 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-0a3ee47b-80bd-446f-ba13-5a3f48ca83d6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:57.809237 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-0a3ee47b-80bd-446f-ba13-5a3f48ca83d6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:57.815877 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0a3ee47b-80bd-446f-ba13-5a3f48ca83d6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:57.816355 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0a3ee47b-80bd-446f-ba13-5a3f48ca83d6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:57.817131 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0a3ee47b-80bd-446f-ba13-5a3f48ca83d6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:57.817568 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0a3ee47b-80bd-446f-ba13-5a3f48ca83d6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:57.913994 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fb50490c-c038-4832-a404-4edce5c6cfa5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:57.916257 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fb50490c-c038-4832-a404-4edce5c6cfa5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:57.923054 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb50490c-c038-4832-a404-4edce5c6cfa5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:57.923507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb50490c-c038-4832-a404-4edce5c6cfa5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:57.924336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb50490c-c038-4832-a404-4edce5c6cfa5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:57.924775 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb50490c-c038-4832-a404-4edce5c6cfa5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:57.966281 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-0a3ee47b-80bd-446f-ba13-5a3f48ca83d6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:57.976143 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-0a3ee47b-80bd-446f-ba13-5a3f48ca83d6 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.171999 May 09 04:31:57.985658 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 422/826] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:57 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:58.071771 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fb50490c-c038-4832-a404-4edce5c6cfa5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:58.079985 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fb50490c-c038-4832-a404-4edce5c6cfa5 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.169859 May 09 04:31:58.080580 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 405/827] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:57 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:58.123667 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-897ceb8b-8262-4383-a873-7c04f5d3600f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:58.124300 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-897ceb8b-8262-4383-a873-7c04f5d3600f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:58.130345 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-897ceb8b-8262-4383-a873-7c04f5d3600f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:58.130792 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-897ceb8b-8262-4383-a873-7c04f5d3600f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:58.131555 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-897ceb8b-8262-4383-a873-7c04f5d3600f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:58.132018 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-897ceb8b-8262-4383-a873-7c04f5d3600f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:58.215001 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8b870893-13e9-4584-a62f-90adcff5e428 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:58.215672 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8b870893-13e9-4584-a62f-90adcff5e428 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:58.221735 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b870893-13e9-4584-a62f-90adcff5e428 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:58.222183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b870893-13e9-4584-a62f-90adcff5e428 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:58.222945 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b870893-13e9-4584-a62f-90adcff5e428 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:58.223381 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b870893-13e9-4584-a62f-90adcff5e428 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:58.260821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-897ceb8b-8262-4383-a873-7c04f5d3600f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:58.270986 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-897ceb8b-8262-4383-a873-7c04f5d3600f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:58.272609 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-897ceb8b-8262-4383-a873-7c04f5d3600f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:58.273761 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-897ceb8b-8262-4383-a873-7c04f5d3600f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.154023 May 09 04:31:58.274322 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 423/828] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:31:58 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:31:58.355323 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8b870893-13e9-4584-a62f-90adcff5e428 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:58.362470 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8b870893-13e9-4584-a62f-90adcff5e428 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.151916 May 09 04:31:58.363034 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 406/829] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:58 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:58.995152 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3e858ee4-7148-4873-b4f9-909e36def18f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:58.995769 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-3e858ee4-7148-4873-b4f9-909e36def18f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:59.002156 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3e858ee4-7148-4873-b4f9-909e36def18f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:59.002605 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3e858ee4-7148-4873-b4f9-909e36def18f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:59.003365 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3e858ee4-7148-4873-b4f9-909e36def18f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:59.003802 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3e858ee4-7148-4873-b4f9-909e36def18f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:59.097721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-94c02772-8d3f-477a-8cad-276ec894a957 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:59.098334 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-94c02772-8d3f-477a-8cad-276ec894a957 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:59.105050 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94c02772-8d3f-477a-8cad-276ec894a957 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:59.105498 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94c02772-8d3f-477a-8cad-276ec894a957 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:59.106264 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94c02772-8d3f-477a-8cad-276ec894a957 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:59.106698 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94c02772-8d3f-477a-8cad-276ec894a957 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:59.132837 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3e858ee4-7148-4873-b4f9-909e36def18f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:59.141117 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-3e858ee4-7148-4873-b4f9-909e36def18f tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1521 microversion: 2.1 time: 0.150110 May 09 04:31:59.141694 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 424/830] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:58 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:31:59.236923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-94c02772-8d3f-477a-8cad-276ec894a957 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:59.244806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-94c02772-8d3f-477a-8cad-276ec894a957 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.150895 May 09 04:31:59.245377 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 407/831] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:59 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:59.292208 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-66f13598-a34a-4d0f-bbe8-69b445723b54 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:59.292818 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-66f13598-a34a-4d0f-bbe8-69b445723b54 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:59.298779 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-66f13598-a34a-4d0f-bbe8-69b445723b54 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:59.299222 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-66f13598-a34a-4d0f-bbe8-69b445723b54 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:59.300011 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-66f13598-a34a-4d0f-bbe8-69b445723b54 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:59.300444 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-66f13598-a34a-4d0f-bbe8-69b445723b54 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:59.379250 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dc6fabfe-78e2-4604-869c-cec26055f9a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:31:59.379965 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dc6fabfe-78e2-4604-869c-cec26055f9a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:31:59.388921 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc6fabfe-78e2-4604-869c-cec26055f9a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:59.389351 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc6fabfe-78e2-4604-869c-cec26055f9a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:59.390161 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc6fabfe-78e2-4604-869c-cec26055f9a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:59.390587 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc6fabfe-78e2-4604-869c-cec26055f9a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:31:59.426298 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-66f13598-a34a-4d0f-bbe8-69b445723b54 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:59.435302 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-66f13598-a34a-4d0f-bbe8-69b445723b54 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:59.436831 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-66f13598-a34a-4d0f-bbe8-69b445723b54 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:59.438003 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-66f13598-a34a-4d0f-bbe8-69b445723b54 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.149895 May 09 04:31:59.438572 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 425/832] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:31:59 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:31:59.527670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dc6fabfe-78e2-4604-869c-cec26055f9a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:31:59.534989 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dc6fabfe-78e2-4604-869c-cec26055f9a7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.159723 May 09 04:31:59.535589 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 408/833] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:31:59 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:31:59.981880 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-a23ed962-8820-47c3-a6dd-dbb5c155e139 req-3aa15d75-9ac4-4693-baa7-2c348ef24ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6774e618-8e5f-4815-8e60-0473be16aabc", "name": "network-vif-deleted", "tag": "e75b43e2-a1dd-4d55-b4da-8e6449521a74"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:31:59.990485 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-a23ed962-8820-47c3-a6dd-dbb5c155e139 req-3aa15d75-9ac4-4693-baa7-2c348ef24ecd service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:31:59.990918 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-a23ed962-8820-47c3-a6dd-dbb5c155e139 req-3aa15d75-9ac4-4693-baa7-2c348ef24ecd service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:00.003547 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-a23ed962-8820-47c3-a6dd-dbb5c155e139 req-3aa15d75-9ac4-4693-baa7-2c348ef24ecd service nova] Creating event network-vif-deleted:e75b43e2-a1dd-4d55-b4da-8e6449521a74 for instance 6774e618-8e5f-4815-8e60-0473be16aabc on hv-cinder-83800 May 09 04:32:00.008131 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-a23ed962-8820-47c3-a6dd-dbb5c155e139 req-3aa15d75-9ac4-4693-baa7-2c348ef24ecd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030591 May 09 04:32:00.008773 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 426/834] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:00.158734 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1936b45b-c623-40ad-8de0-f28ee4c1b213 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:00.159252 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1936b45b-c623-40ad-8de0-f28ee4c1b213 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:00.166361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1936b45b-c623-40ad-8de0-f28ee4c1b213 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:00.166813 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1936b45b-c623-40ad-8de0-f28ee4c1b213 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:00.167576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1936b45b-c623-40ad-8de0-f28ee4c1b213 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:00.168039 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1936b45b-c623-40ad-8de0-f28ee4c1b213 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:00.200210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1936b45b-c623-40ad-8de0-f28ee4c1b213 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:00.200583 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1936b45b-c623-40ad-8de0-f28ee4c1b213 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:00.201026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-1936b45b-c623-40ad-8de0-f28ee4c1b213 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lazy-loading 'fault' on Instance uuid 6774e618-8e5f-4815-8e60-0473be16aabc {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:32:00.241446 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1936b45b-c623-40ad-8de0-f28ee4c1b213 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:00.248663 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1936b45b-c623-40ad-8de0-f28ee4c1b213 tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1310 microversion: 2.1 time: 0.093917 May 09 04:32:00.249231 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 409/835] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:00 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:00.261975 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-94adce30-6e48-4813-8f31-890736225205 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:00.262697 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-94adce30-6e48-4813-8f31-890736225205 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:00.269339 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-94adce30-6e48-4813-8f31-890736225205 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:00.269791 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-94adce30-6e48-4813-8f31-890736225205 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:00.270573 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-94adce30-6e48-4813-8f31-890736225205 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:00.271036 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-94adce30-6e48-4813-8f31-890736225205 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:00.408669 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-94adce30-6e48-4813-8f31-890736225205 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:00.417371 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-94adce30-6e48-4813-8f31-890736225205 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1575 microversion: 2.1 time: 0.159516 May 09 04:32:00.417949 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 427/836] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:00 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:00.457022 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a510ce3c-41d0-4fb5-923e-57d549764454 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:00.457621 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a510ce3c-41d0-4fb5-923e-57d549764454 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:00.464421 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a510ce3c-41d0-4fb5-923e-57d549764454 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:00.464860 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a510ce3c-41d0-4fb5-923e-57d549764454 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:00.465780 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a510ce3c-41d0-4fb5-923e-57d549764454 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:00.466214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a510ce3c-41d0-4fb5-923e-57d549764454 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:00.552052 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-dd19d8fb-331b-4a7a-a94a-c7560655d637 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:00.552674 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-dd19d8fb-331b-4a7a-a94a-c7560655d637 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:00.559249 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dd19d8fb-331b-4a7a-a94a-c7560655d637 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:00.559701 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dd19d8fb-331b-4a7a-a94a-c7560655d637 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:00.560497 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dd19d8fb-331b-4a7a-a94a-c7560655d637 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:00.560940 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dd19d8fb-331b-4a7a-a94a-c7560655d637 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:00.596359 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a510ce3c-41d0-4fb5-923e-57d549764454 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:00.605511 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a510ce3c-41d0-4fb5-923e-57d549764454 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:00.607109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a510ce3c-41d0-4fb5-923e-57d549764454 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:00.608374 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a510ce3c-41d0-4fb5-923e-57d549764454 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.155277 May 09 04:32:00.609031 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 410/837] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:00 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:00.690736 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-dd19d8fb-331b-4a7a-a94a-c7560655d637 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:00.697959 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-dd19d8fb-331b-4a7a-a94a-c7560655d637 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.149759 May 09 04:32:00.698527 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 428/838] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:00 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:32:01.268161 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1578ecb2-96a9-47ab-81cb-6d56c38685ff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:01.268927 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1578ecb2-96a9-47ab-81cb-6d56c38685ff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:01.277223 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1578ecb2-96a9-47ab-81cb-6d56c38685ff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:01.277677 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1578ecb2-96a9-47ab-81cb-6d56c38685ff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:01.278588 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1578ecb2-96a9-47ab-81cb-6d56c38685ff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:01.279116 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1578ecb2-96a9-47ab-81cb-6d56c38685ff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:01.314785 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1578ecb2-96a9-47ab-81cb-6d56c38685ff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:01.315228 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1578ecb2-96a9-47ab-81cb-6d56c38685ff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:01.315670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-1578ecb2-96a9-47ab-81cb-6d56c38685ff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lazy-loading 'fault' on Instance uuid 6774e618-8e5f-4815-8e60-0473be16aabc {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:32:01.357149 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1578ecb2-96a9-47ab-81cb-6d56c38685ff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b7c3ec77d4493dac92bb61d0b376be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d5139952d450fa3b7da38a62d7a03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:01.363795 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1578ecb2-96a9-47ab-81cb-6d56c38685ff tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 200 len: 1310 microversion: 2.1 time: 0.100902 May 09 04:32:01.364392 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 411/839] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:01 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 1310 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:01.434557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c3b382db-faee-444c-9a09-3a8584c606fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:01.435162 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c3b382db-faee-444c-9a09-3a8584c606fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:01.441851 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c3b382db-faee-444c-9a09-3a8584c606fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:01.442295 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c3b382db-faee-444c-9a09-3a8584c606fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:01.443060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c3b382db-faee-444c-9a09-3a8584c606fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:01.443492 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c3b382db-faee-444c-9a09-3a8584c606fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:01.578869 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c3b382db-faee-444c-9a09-3a8584c606fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:01.586481 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c3b382db-faee-444c-9a09-3a8584c606fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1562 microversion: 2.1 time: 0.156963 May 09 04:32:01.587061 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 429/840] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:01 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:01.627020 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fa087387-51b9-40a8-8cd1-943ea3bc8b16 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:01.627622 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fa087387-51b9-40a8-8cd1-943ea3bc8b16 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:01.633580 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa087387-51b9-40a8-8cd1-943ea3bc8b16 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:01.634025 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa087387-51b9-40a8-8cd1-943ea3bc8b16 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:01.635446 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa087387-51b9-40a8-8cd1-943ea3bc8b16 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:01.635882 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa087387-51b9-40a8-8cd1-943ea3bc8b16 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:01.717374 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-23347690-a65d-4a0e-8727-5f79839f2bd5 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:01.718000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-23347690-a65d-4a0e-8727-5f79839f2bd5 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:01.724042 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-23347690-a65d-4a0e-8727-5f79839f2bd5 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:01.724532 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-23347690-a65d-4a0e-8727-5f79839f2bd5 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:01.725315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-23347690-a65d-4a0e-8727-5f79839f2bd5 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:01.725759 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-23347690-a65d-4a0e-8727-5f79839f2bd5 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:01.766036 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fa087387-51b9-40a8-8cd1-943ea3bc8b16 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:01.774127 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fa087387-51b9-40a8-8cd1-943ea3bc8b16 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:01.776076 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fa087387-51b9-40a8-8cd1-943ea3bc8b16 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:01.777447 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fa087387-51b9-40a8-8cd1-943ea3bc8b16 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.154298 May 09 04:32:01.778081 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 412/841] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:01 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:01.859248 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-23347690-a65d-4a0e-8727-5f79839f2bd5 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:01.866916 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-23347690-a65d-4a0e-8727-5f79839f2bd5 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.156048 May 09 04:32:01.867508 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 430/842] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:01 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:32:02.379923 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f2c7d8e4-59ad-4b71-9548-20d26a701a4d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:02.380521 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f2c7d8e4-59ad-4b71-9548-20d26a701a4d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] [instance: 6774e618-8e5f-4815-8e60-0473be16aabc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:02.387562 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2c7d8e4-59ad-4b71-9548-20d26a701a4d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:02.388034 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2c7d8e4-59ad-4b71-9548-20d26a701a4d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:02.388797 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2c7d8e4-59ad-4b71-9548-20d26a701a4d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:02.389218 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2c7d8e4-59ad-4b71-9548-20d26a701a4d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:02.403082 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-f2c7d8e4-59ad-4b71-9548-20d26a701a4d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] HTTP exception thrown: Instance 6774e618-8e5f-4815-8e60-0473be16aabc could not be found. May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f2c7d8e4-59ad-4b71-9548-20d26a701a4d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Request method failure captured: May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc HTTP/1.1 May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJf7cd7GDKD--ciqHRq6mwpqDN3h9WRQb3Nc7UnOPo5U2WWp_HyVseZh-Z25QJN0hWRsF1_rRoMji4tz5UYqyzyZD9uv_aEy-DLscIeYW26RnR5edf_QFqZ2j-8nWp_I7Woej_Jl3fU2TVCdYMFK88Cwyxa_cQIHDAAuA7M0Y3pC4Zw May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: d28d5139952d450fa3b7da38a62d7a03 May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:32:02.404751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:32:02.406214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d28d5139952d450fa3b7da38a62d7a03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:32:02.406214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:32:02.406214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: d28d5139952d450fa3b7da38a62d7a03 May 09 04:32:02.406214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1341609376 May 09 04:32:02.406214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-ServerRescueNegativeTestJSON-1341609376-project May 09 04:32:02.406214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:32:02.406214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:32:02.406214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 87b7c3ec77d4493dac92bb61d0b376be May 09 04:32:02.406214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1341609376-project May 09 04:32:02.406214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:32:02.406214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 6774e618-8e5f-4815-8e60-0473be16aabc could not be found. May 09 04:32:02.406214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '6774e618-8e5f-4815-8e60-0473be16aabc'} May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6774e618-8e5f-4815-8e60-0473be16aabc could not be found. May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:32:02.407026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6774e618-8e5f-4815-8e60-0473be16aabc could not be found. May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6774e618-8e5f-4815-8e60-0473be16aabc could not be found. May 09 04:32:02.408414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:32:02.409703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f2c7d8e4-59ad-4b71-9548-20d26a701a4d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] Returning 404 to user: Instance 6774e618-8e5f-4815-8e60-0473be16aabc could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:32:02.409703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f2c7d8e4-59ad-4b71-9548-20d26a701a4d tempest-ServerRescueNegativeTestJSON-1341609376 tempest-ServerRescueNegativeTestJSON-1341609376-project] 10.222.0.44 "GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc" status: 404 len: 111 microversion: 2.1 time: 0.030063 May 09 04:32:02.409703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 413/843] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:02 2022] GET /compute/v2.1/servers/6774e618-8e5f-4815-8e60-0473be16aabc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:32:02.797032 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b66157e5-399a-4ba9-8093-acdb74663aaa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:02.798252 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b66157e5-399a-4ba9-8093-acdb74663aaa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:02.804997 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b66157e5-399a-4ba9-8093-acdb74663aaa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:02.805693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b66157e5-399a-4ba9-8093-acdb74663aaa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:02.807266 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b66157e5-399a-4ba9-8093-acdb74663aaa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:02.807873 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b66157e5-399a-4ba9-8093-acdb74663aaa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:02.883025 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5464f9dc-5f08-4b2a-b6f7-6c205c098e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:02.883813 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5464f9dc-5f08-4b2a-b6f7-6c205c098e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:02.891107 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5464f9dc-5f08-4b2a-b6f7-6c205c098e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:02.892091 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5464f9dc-5f08-4b2a-b6f7-6c205c098e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:02.892610 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5464f9dc-5f08-4b2a-b6f7-6c205c098e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:02.893323 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5464f9dc-5f08-4b2a-b6f7-6c205c098e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:03.013913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b66157e5-399a-4ba9-8093-acdb74663aaa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:03.021992 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b66157e5-399a-4ba9-8093-acdb74663aaa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:03.023598 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b66157e5-399a-4ba9-8093-acdb74663aaa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:03.025959 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b66157e5-399a-4ba9-8093-acdb74663aaa tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.231855 May 09 04:32:03.028456 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 431/844] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:02 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:03.038645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5464f9dc-5f08-4b2a-b6f7-6c205c098e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:03.046924 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5464f9dc-5f08-4b2a-b6f7-6c205c098e19 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.167907 May 09 04:32:03.047817 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 414/845] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:02 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:03.383638 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ebc325be-1a83-4998-b0c2-d688a83b5391 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:03.384164 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ebc325be-1a83-4998-b0c2-d688a83b5391 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:03.390747 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ebc325be-1a83-4998-b0c2-d688a83b5391 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:03.391205 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ebc325be-1a83-4998-b0c2-d688a83b5391 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:03.392003 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ebc325be-1a83-4998-b0c2-d688a83b5391 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:03.392445 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ebc325be-1a83-4998-b0c2-d688a83b5391 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:03.415644 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ebc325be-1a83-4998-b0c2-d688a83b5391 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/ips" status: 200 len: 150 microversion: 2.1 time: 0.035797 May 09 04:32:03.416301 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 432/846] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 04:32:03 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:04.042596 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e082b786-52f6-41be-8a20-ca822fb8fbee tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:04.043211 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e082b786-52f6-41be-8a20-ca822fb8fbee tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:04.049459 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e082b786-52f6-41be-8a20-ca822fb8fbee tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:04.049902 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e082b786-52f6-41be-8a20-ca822fb8fbee tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:04.050657 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e082b786-52f6-41be-8a20-ca822fb8fbee tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:04.051082 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e082b786-52f6-41be-8a20-ca822fb8fbee tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:04.064351 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-87b573bb-d05e-42eb-aaab-38efb4d00f49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:04.065686 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-87b573bb-d05e-42eb-aaab-38efb4d00f49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:04.073921 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-87b573bb-d05e-42eb-aaab-38efb4d00f49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:04.074634 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-87b573bb-d05e-42eb-aaab-38efb4d00f49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:04.075751 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-87b573bb-d05e-42eb-aaab-38efb4d00f49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:04.076439 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-87b573bb-d05e-42eb-aaab-38efb4d00f49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:04.206099 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e082b786-52f6-41be-8a20-ca822fb8fbee tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:04.215172 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e082b786-52f6-41be-8a20-ca822fb8fbee tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:04.216717 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e082b786-52f6-41be-8a20-ca822fb8fbee tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:04.218090 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e082b786-52f6-41be-8a20-ca822fb8fbee tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.179462 May 09 04:32:04.229375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 415/847] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:04 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:04.346963 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-87b573bb-d05e-42eb-aaab-38efb4d00f49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:04.356136 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-87b573bb-d05e-42eb-aaab-38efb4d00f49 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.295982 May 09 04:32:04.356880 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 433/848] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:04 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:32:04.778736 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-670eabbd-ab93-4785-92e6-2f5ec714c4de req-90196121-15c8-4822-99b8-922b13124f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0064c5db-f056-49f6-a8ba-54c3f60c41ec", "name": "network-vif-plugged", "status": "completed", "tag": "e05ee7be-8781-44a0-8ae2-fb665919b80b"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:04.789566 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-670eabbd-ab93-4785-92e6-2f5ec714c4de req-90196121-15c8-4822-99b8-922b13124f69 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:04.790002 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-670eabbd-ab93-4785-92e6-2f5ec714c4de req-90196121-15c8-4822-99b8-922b13124f69 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:04.801975 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f2a9b7c6-d5e5-4062-8368-f4828369530d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bc83501-c230-45cf-a780-45a60295deb9"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:04.805672 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-670eabbd-ab93-4785-92e6-2f5ec714c4de req-90196121-15c8-4822-99b8-922b13124f69 service nova] Creating event network-vif-plugged:e05ee7be-8781-44a0-8ae2-fb665919b80b for instance 0064c5db-f056-49f6-a8ba-54c3f60c41ec on hv-cinder-83800 May 09 04:32:04.810064 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f2a9b7c6-d5e5-4062-8368-f4828369530d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:04.817417 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-670eabbd-ab93-4785-92e6-2f5ec714c4de req-90196121-15c8-4822-99b8-922b13124f69 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182674 May 09 04:32:04.818029 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 416/849] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:04.820119 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f2a9b7c6-d5e5-4062-8368-f4828369530d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:04.820978 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f2a9b7c6-d5e5-4062-8368-f4828369530d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:04.822699 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f2a9b7c6-d5e5-4062-8368-f4828369530d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:04.823514 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f2a9b7c6-d5e5-4062-8368-f4828369530d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:05.151918 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f2a9b7c6-d5e5-4062-8368-f4828369530d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "POST /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356221 May 09 04:32:05.153341 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 434/850] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 04:32:04 2022] POST /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:32:05.237730 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c383bc43-2ff0-40ea-8a03-a92fb0efd801 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:05.238580 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c383bc43-2ff0-40ea-8a03-a92fb0efd801 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:05.245984 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c383bc43-2ff0-40ea-8a03-a92fb0efd801 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:05.246669 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c383bc43-2ff0-40ea-8a03-a92fb0efd801 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:05.247540 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c383bc43-2ff0-40ea-8a03-a92fb0efd801 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:05.248096 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c383bc43-2ff0-40ea-8a03-a92fb0efd801 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:05.376699 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ca572346-fb47-4e22-9010-51057cb11fcf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:05.380399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ca572346-fb47-4e22-9010-51057cb11fcf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:05.390811 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ca572346-fb47-4e22-9010-51057cb11fcf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:05.391270 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ca572346-fb47-4e22-9010-51057cb11fcf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:05.392190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ca572346-fb47-4e22-9010-51057cb11fcf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:05.392625 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ca572346-fb47-4e22-9010-51057cb11fcf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:05.420955 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c383bc43-2ff0-40ea-8a03-a92fb0efd801 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:05.431335 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c383bc43-2ff0-40ea-8a03-a92fb0efd801 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:05.433056 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c383bc43-2ff0-40ea-8a03-a92fb0efd801 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:05.434484 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c383bc43-2ff0-40ea-8a03-a92fb0efd801 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.201148 May 09 04:32:05.435159 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 417/851] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:05 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:05.651778 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ca572346-fb47-4e22-9010-51057cb11fcf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:05.670630 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ca572346-fb47-4e22-9010-51057cb11fcf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1265 microversion: 2.1 time: 0.300621 May 09 04:32:05.671482 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 435/852] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:05 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:06.453145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-144b5174-c314-4cfa-9a89-c036307635c1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:06.453746 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-144b5174-c314-4cfa-9a89-c036307635c1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:06.460075 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-144b5174-c314-4cfa-9a89-c036307635c1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:06.460518 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-144b5174-c314-4cfa-9a89-c036307635c1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:06.461274 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-144b5174-c314-4cfa-9a89-c036307635c1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:06.461697 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-144b5174-c314-4cfa-9a89-c036307635c1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:06.599439 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-144b5174-c314-4cfa-9a89-c036307635c1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:06.609135 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-144b5174-c314-4cfa-9a89-c036307635c1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:06.611325 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-144b5174-c314-4cfa-9a89-c036307635c1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:06.614383 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-144b5174-c314-4cfa-9a89-c036307635c1 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.164069 May 09 04:32:06.615303 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 418/853] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:06 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:06.687383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-05814adc-cdc1-48b7-a2c4-8b19d263431f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:06.688095 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-05814adc-cdc1-48b7-a2c4-8b19d263431f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:06.694391 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05814adc-cdc1-48b7-a2c4-8b19d263431f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:06.694939 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05814adc-cdc1-48b7-a2c4-8b19d263431f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:06.695787 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05814adc-cdc1-48b7-a2c4-8b19d263431f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:06.696249 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05814adc-cdc1-48b7-a2c4-8b19d263431f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:06.834224 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-05814adc-cdc1-48b7-a2c4-8b19d263431f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:06.842332 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-05814adc-cdc1-48b7-a2c4-8b19d263431f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1453 microversion: 2.1 time: 0.159007 May 09 04:32:06.842894 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 436/854] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:06 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:06.858116 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4aa3bbcd-e56f-42c7-8197-41e2550fab48 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:06.858756 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4aa3bbcd-e56f-42c7-8197-41e2550fab48 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:06.864657 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4aa3bbcd-e56f-42c7-8197-41e2550fab48 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:06.865101 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4aa3bbcd-e56f-42c7-8197-41e2550fab48 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:06.865849 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4aa3bbcd-e56f-42c7-8197-41e2550fab48 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:06.866559 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4aa3bbcd-e56f-42c7-8197-41e2550fab48 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:07.005581 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4aa3bbcd-e56f-42c7-8197-41e2550fab48 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:07.013636 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4aa3bbcd-e56f-42c7-8197-41e2550fab48 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1453 microversion: 2.1 time: 0.159410 May 09 04:32:07.014219 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 419/855] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:06 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:07.634101 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4604131c-539a-46b7-bc83-54aee9ce5dd9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:07.635549 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-4604131c-539a-46b7-bc83-54aee9ce5dd9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:07.641565 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4604131c-539a-46b7-bc83-54aee9ce5dd9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:07.642221 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4604131c-539a-46b7-bc83-54aee9ce5dd9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:07.642997 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4604131c-539a-46b7-bc83-54aee9ce5dd9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:07.643430 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4604131c-539a-46b7-bc83-54aee9ce5dd9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:07.845616 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4604131c-539a-46b7-bc83-54aee9ce5dd9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:07.854304 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4604131c-539a-46b7-bc83-54aee9ce5dd9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:07.855811 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4604131c-539a-46b7-bc83-54aee9ce5dd9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:07.857000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-4604131c-539a-46b7-bc83-54aee9ce5dd9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.226765 May 09 04:32:07.857557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 437/856] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:07 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:08.875872 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6a27c68f-3e88-4f57-9f7d-db28787c95b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:08.876824 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6a27c68f-3e88-4f57-9f7d-db28787c95b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:08.884111 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a27c68f-3e88-4f57-9f7d-db28787c95b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:08.884648 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a27c68f-3e88-4f57-9f7d-db28787c95b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:08.885437 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a27c68f-3e88-4f57-9f7d-db28787c95b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:08.885935 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a27c68f-3e88-4f57-9f7d-db28787c95b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:09.116372 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6a27c68f-3e88-4f57-9f7d-db28787c95b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:09.127522 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6a27c68f-3e88-4f57-9f7d-db28787c95b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:09.129216 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6a27c68f-3e88-4f57-9f7d-db28787c95b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:09.130747 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6a27c68f-3e88-4f57-9f7d-db28787c95b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.259167 May 09 04:32:09.137478 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 420/857] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:08 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:32:09.370882 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-ef838905-da74-4e48-a57d-dcf6dc2f3df1 req-5604b729-4f49-4de5-b1e7-e8b530da92c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0064c5db-f056-49f6-a8ba-54c3f60c41ec", "tag": "e05ee7be-8781-44a0-8ae2-fb665919b80b"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:09.381036 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-ef838905-da74-4e48-a57d-dcf6dc2f3df1 req-5604b729-4f49-4de5-b1e7-e8b530da92c8 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:09.381662 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-ef838905-da74-4e48-a57d-dcf6dc2f3df1 req-5604b729-4f49-4de5-b1e7-e8b530da92c8 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:09.395408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-ef838905-da74-4e48-a57d-dcf6dc2f3df1 req-5604b729-4f49-4de5-b1e7-e8b530da92c8 service nova] Creating event network-changed:e05ee7be-8781-44a0-8ae2-fb665919b80b for instance 0064c5db-f056-49f6-a8ba-54c3f60c41ec on hv-cinder-83800 May 09 04:32:09.401983 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-ef838905-da74-4e48-a57d-dcf6dc2f3df1 req-5604b729-4f49-4de5-b1e7-e8b530da92c8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036179 May 09 04:32:09.406614 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 438/858] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:10.150120 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-87fb76e1-6881-4566-b2c7-2c39f305e02d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:10.150722 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-87fb76e1-6881-4566-b2c7-2c39f305e02d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:10.157631 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-87fb76e1-6881-4566-b2c7-2c39f305e02d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:10.158096 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-87fb76e1-6881-4566-b2c7-2c39f305e02d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:10.159058 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-87fb76e1-6881-4566-b2c7-2c39f305e02d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:10.159495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-87fb76e1-6881-4566-b2c7-2c39f305e02d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:10.299189 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-87fb76e1-6881-4566-b2c7-2c39f305e02d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:10.309568 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-87fb76e1-6881-4566-b2c7-2c39f305e02d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:10.311317 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-87fb76e1-6881-4566-b2c7-2c39f305e02d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:10.312711 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-87fb76e1-6881-4566-b2c7-2c39f305e02d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.166706 May 09 04:32:10.314549 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 421/859] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:10 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:11.334574 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-df921bff-3380-4b9c-93ce-0bfe153509e6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:11.335270 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-df921bff-3380-4b9c-93ce-0bfe153509e6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:11.343365 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df921bff-3380-4b9c-93ce-0bfe153509e6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:11.343820 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df921bff-3380-4b9c-93ce-0bfe153509e6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:11.344647 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df921bff-3380-4b9c-93ce-0bfe153509e6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:11.345084 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df921bff-3380-4b9c-93ce-0bfe153509e6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:11.486448 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-df921bff-3380-4b9c-93ce-0bfe153509e6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:11.496523 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-df921bff-3380-4b9c-93ce-0bfe153509e6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:11.498237 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-df921bff-3380-4b9c-93ce-0bfe153509e6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:11.499527 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-df921bff-3380-4b9c-93ce-0bfe153509e6 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.169733 May 09 04:32:11.500292 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 439/860] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:11 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:12.518292 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-17779a6a-0064-4f01-942b-1e6615bb1aa2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:12.519005 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-17779a6a-0064-4f01-942b-1e6615bb1aa2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:12.525893 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17779a6a-0064-4f01-942b-1e6615bb1aa2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:12.526364 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17779a6a-0064-4f01-942b-1e6615bb1aa2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:12.527482 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17779a6a-0064-4f01-942b-1e6615bb1aa2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:12.527829 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17779a6a-0064-4f01-942b-1e6615bb1aa2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:12.664862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-17779a6a-0064-4f01-942b-1e6615bb1aa2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:12.672913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-17779a6a-0064-4f01-942b-1e6615bb1aa2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:12.674336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-17779a6a-0064-4f01-942b-1e6615bb1aa2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:12.675494 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-17779a6a-0064-4f01-942b-1e6615bb1aa2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1744 microversion: 2.20 time: 0.160950 May 09 04:32:12.676382 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 422/861] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:12 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:12.769017 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4120ce3e-3a97-44be-9778-2df7dcb8b075 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bc83501-c230-45cf-a780-45a60295deb9"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:12.770069 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-4120ce3e-3a97-44be-9778-2df7dcb8b075 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:12.777188 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4120ce3e-3a97-44be-9778-2df7dcb8b075 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:12.777635 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4120ce3e-3a97-44be-9778-2df7dcb8b075 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:12.778394 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4120ce3e-3a97-44be-9778-2df7dcb8b075 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:12.778824 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4120ce3e-3a97-44be-9778-2df7dcb8b075 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:12.857460 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-4120ce3e-3a97-44be-9778-2df7dcb8b075 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] HTTP exception thrown: Invalid volume: volume 1bc83501-c230-45cf-a780-45a60295deb9 is already attached to instances: 8206836d-7fa2-48b8-8d4c-46c70608a3e0 May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4120ce3e-3a97-44be-9778-2df7dcb8b075 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Request method failure captured: May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: POST /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/os-volume_attachments HTTP/1.1 May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 74 May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJhTbCVgTT3HZuxvtZpJ_cLiO-p5aO5ZCrkaJhYtCXNfzo_IXS3499vPTrl-cgrMt-SnaVL5V4wtRTXaaPRZskqvbSNvwlk-mrGJOcozoTU2E5zQ45dYOd-AEzlNKKX4qka08Rdzwq7NFgcZCZDko0TOyv7hyBbf4It5Ltr84wDaqIk May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:32:12.859171 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:32:12.860737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:32:12.860737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-AttachVolumeNegativeTest-70527954 May 09 04:32:12.860737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:32:12.860737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:32:12.860737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:32:12.860737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:32:12.860737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:32:12.860737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: c56a403eeee84720ba765e2d4367df74 May 09 04:32:12.860737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:32:12.860737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: May 09 04:32:12.860737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {"volumeAttachment": {"volumeId": "1bc83501-c230-45cf-a780-45a60295deb9"}} May 09 04:32:12.860737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Invalid volume: volume 1bc83501-c230-45cf-a780-45a60295deb9 is already attached to instances: 8206836d-7fa2-48b8-8d4c-46c70608a3e0 May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'server_id': '8206836d-7fa2-48b8-8d4c-46c70608a3e0', 'body': {'volumeAttachment': {'volumeId': '1bc83501-c230-45cf-a780-45a60295deb9'}}} May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1bc83501-c230-45cf-a780-45a60295deb9 is already attached to instances: 8206836d-7fa2-48b8-8d4c-46c70608a3e0 May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:32:12.861632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1bc83501-c230-45cf-a780-45a60295deb9 is already attached to instances: 8206836d-7fa2-48b8-8d4c-46c70608a3e0 May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:32:12.862972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:32:12.865325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:32:12.865325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:32:12.865325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:32:12.865325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1bc83501-c230-45cf-a780-45a60295deb9 is already attached to instances: 8206836d-7fa2-48b8-8d4c-46c70608a3e0 May 09 04:32:12.865325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:32:12.865325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4120ce3e-3a97-44be-9778-2df7dcb8b075 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Returning 400 to user: Invalid volume: volume 1bc83501-c230-45cf-a780-45a60295deb9 is already attached to instances: 8206836d-7fa2-48b8-8d4c-46c70608a3e0 {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:32:12.865325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-4120ce3e-3a97-44be-9778-2df7dcb8b075 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "POST /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095514 May 09 04:32:12.865325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 440/862] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 04:32:12 2022] POST /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 04:32:12.927543 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2a7dff80-ffd1-4aaa-8ed1-3b61b642b6d8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:12.927982 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2a7dff80-ffd1-4aaa-8ed1-3b61b642b6d8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:12.934274 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2a7dff80-ffd1-4aaa-8ed1-3b61b642b6d8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:12.934716 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2a7dff80-ffd1-4aaa-8ed1-3b61b642b6d8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:12.935471 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2a7dff80-ffd1-4aaa-8ed1-3b61b642b6d8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:12.935924 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2a7dff80-ffd1-4aaa-8ed1-3b61b642b6d8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:13.013795 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-2a7dff80-ffd1-4aaa-8ed1-3b61b642b6d8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lazy-loading 'services' on Instance uuid 8206836d-7fa2-48b8-8d4c-46c70608a3e0 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:32:13.086148 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2a7dff80-ffd1-4aaa-8ed1-3b61b642b6d8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/os-volume_attachments/1bc83501-c230-45cf-a780-45a60295deb9" status: 202 len: 0 microversion: 2.1 time: 0.162438 May 09 04:32:13.086919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 423/863] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 04:32:12 2022] DELETE /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/os-volume_attachments/1bc83501-c230-45cf-a780-45a60295deb9 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:32:13.096734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6bb35daf-c9ff-466e-95be-a6f762ba7dc8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:13.097793 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6bb35daf-c9ff-466e-95be-a6f762ba7dc8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:13.105259 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6bb35daf-c9ff-466e-95be-a6f762ba7dc8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:13.105963 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6bb35daf-c9ff-466e-95be-a6f762ba7dc8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:13.106761 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6bb35daf-c9ff-466e-95be-a6f762ba7dc8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:13.107207 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6bb35daf-c9ff-466e-95be-a6f762ba7dc8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:13.138892 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6bb35daf-c9ff-466e-95be-a6f762ba7dc8 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046619 May 09 04:32:13.139632 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 441/864] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:32:13 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:13.695352 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8aa2695f-cb8a-4de9-a7bb-bdd661e57750 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:13.696067 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8aa2695f-cb8a-4de9-a7bb-bdd661e57750 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:13.703371 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8aa2695f-cb8a-4de9-a7bb-bdd661e57750 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:13.703879 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8aa2695f-cb8a-4de9-a7bb-bdd661e57750 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:13.704722 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8aa2695f-cb8a-4de9-a7bb-bdd661e57750 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:13.705214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8aa2695f-cb8a-4de9-a7bb-bdd661e57750 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:13.833535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8aa2695f-cb8a-4de9-a7bb-bdd661e57750 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:13.841781 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8aa2695f-cb8a-4de9-a7bb-bdd661e57750 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:13.843278 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8aa2695f-cb8a-4de9-a7bb-bdd661e57750 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:13.844439 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8aa2695f-cb8a-4de9-a7bb-bdd661e57750 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1744 microversion: 2.20 time: 0.153939 May 09 04:32:13.844999 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 424/865] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:13 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:14.151829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5d04f8f0-9d3e-4856-a5f2-037c0a78c7a3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:14.152777 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5d04f8f0-9d3e-4856-a5f2-037c0a78c7a3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:14.159126 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5d04f8f0-9d3e-4856-a5f2-037c0a78c7a3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:14.159572 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5d04f8f0-9d3e-4856-a5f2-037c0a78c7a3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:14.160369 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5d04f8f0-9d3e-4856-a5f2-037c0a78c7a3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:14.160804 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5d04f8f0-9d3e-4856-a5f2-037c0a78c7a3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:14.189049 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5d04f8f0-9d3e-4856-a5f2-037c0a78c7a3 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041805 May 09 04:32:14.189596 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 442/866] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:32:14 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 04:32:14.246619 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4ef82f63-26dd-492e-9c21-c16f164ea27a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:14.247116 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4ef82f63-26dd-492e-9c21-c16f164ea27a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:14.253363 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4ef82f63-26dd-492e-9c21-c16f164ea27a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:14.253813 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4ef82f63-26dd-492e-9c21-c16f164ea27a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:14.254579 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4ef82f63-26dd-492e-9c21-c16f164ea27a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:14.255018 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4ef82f63-26dd-492e-9c21-c16f164ea27a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:14.279464 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4ef82f63-26dd-492e-9c21-c16f164ea27a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:32:14.364850 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4ef82f63-26dd-492e-9c21-c16f164ea27a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 204 len: 0 microversion: 2.1 time: 0.121876 May 09 04:32:14.365726 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 425/867] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:32:14 2022] DELETE /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:32:14.375866 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e9296529-e5f0-405d-9431-fc8a18098aef tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:14.376542 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e9296529-e5f0-405d-9431-fc8a18098aef tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:14.383372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e9296529-e5f0-405d-9431-fc8a18098aef tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:14.383372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e9296529-e5f0-405d-9431-fc8a18098aef tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:14.384004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e9296529-e5f0-405d-9431-fc8a18098aef tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:14.384462 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e9296529-e5f0-405d-9431-fc8a18098aef tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:14.529049 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e9296529-e5f0-405d-9431-fc8a18098aef tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:14.537081 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e9296529-e5f0-405d-9431-fc8a18098aef tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1680 microversion: 2.1 time: 0.166976 May 09 04:32:14.537658 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 443/868] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:14 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:14.863099 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0c7e6f93-54de-483e-80c4-99e976d9a528 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:14.863796 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0c7e6f93-54de-483e-80c4-99e976d9a528 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:14.870633 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c7e6f93-54de-483e-80c4-99e976d9a528 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:14.871075 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c7e6f93-54de-483e-80c4-99e976d9a528 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:14.871860 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c7e6f93-54de-483e-80c4-99e976d9a528 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:14.872316 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c7e6f93-54de-483e-80c4-99e976d9a528 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:15.006999 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0c7e6f93-54de-483e-80c4-99e976d9a528 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:15.015626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0c7e6f93-54de-483e-80c4-99e976d9a528 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:15.017152 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0c7e6f93-54de-483e-80c4-99e976d9a528 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:15.018340 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0c7e6f93-54de-483e-80c4-99e976d9a528 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1739 microversion: 2.20 time: 0.159578 May 09 04:32:15.018965 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 426/869] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:14 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:15.553766 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e957340f-c3a0-4695-9841-114c72af81a4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:15.554362 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e957340f-c3a0-4695-9841-114c72af81a4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:15.561290 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e957340f-c3a0-4695-9841-114c72af81a4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:15.561734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e957340f-c3a0-4695-9841-114c72af81a4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:15.562493 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e957340f-c3a0-4695-9841-114c72af81a4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:15.562922 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e957340f-c3a0-4695-9841-114c72af81a4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:15.707192 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e957340f-c3a0-4695-9841-114c72af81a4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:15.717254 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e957340f-c3a0-4695-9841-114c72af81a4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1680 microversion: 2.1 time: 0.167233 May 09 04:32:15.718021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 444/870] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:15 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:16.037180 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ee26b76e-3dbf-4368-9dea-2c020e01362f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:16.038464 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ee26b76e-3dbf-4368-9dea-2c020e01362f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:16.045313 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee26b76e-3dbf-4368-9dea-2c020e01362f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:16.045757 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee26b76e-3dbf-4368-9dea-2c020e01362f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:16.046518 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee26b76e-3dbf-4368-9dea-2c020e01362f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:16.046954 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee26b76e-3dbf-4368-9dea-2c020e01362f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:16.264585 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ee26b76e-3dbf-4368-9dea-2c020e01362f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:16.272732 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ee26b76e-3dbf-4368-9dea-2c020e01362f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:16.274215 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ee26b76e-3dbf-4368-9dea-2c020e01362f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:16.275407 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ee26b76e-3dbf-4368-9dea-2c020e01362f tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1739 microversion: 2.20 time: 0.242415 May 09 04:32:16.276670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 427/871] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:16 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:16.737133 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c5290b18-b3ef-44b7-9692-c5fa8560cd5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:16.738379 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c5290b18-b3ef-44b7-9692-c5fa8560cd5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:16.747654 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c5290b18-b3ef-44b7-9692-c5fa8560cd5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:16.748372 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c5290b18-b3ef-44b7-9692-c5fa8560cd5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:16.749532 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c5290b18-b3ef-44b7-9692-c5fa8560cd5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:16.750116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c5290b18-b3ef-44b7-9692-c5fa8560cd5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:16.825133 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c5290b18-b3ef-44b7-9692-c5fa8560cd5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:16.837686 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c5290b18-b3ef-44b7-9692-c5fa8560cd5f tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1612 microversion: 2.1 time: 0.105809 May 09 04:32:16.852236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 445/872] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:16 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1612 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:17.280514 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-675fca12-2675-4b40-8b95-57bbb75a1f00 req-94e99b0a-3f7d-42ac-bbee-5b6bd51ca6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8206836d-7fa2-48b8-8d4c-46c70608a3e0", "name": "network-vif-deleted", "tag": "bdb24e55-7862-4ad0-a43d-7830e3139255"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:17.295506 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-774ebfe5-2d55-4313-8e00-469d210755f7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:17.296801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-774ebfe5-2d55-4313-8e00-469d210755f7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:17.310478 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-774ebfe5-2d55-4313-8e00-469d210755f7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:17.313234 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-774ebfe5-2d55-4313-8e00-469d210755f7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:17.314423 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-774ebfe5-2d55-4313-8e00-469d210755f7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:17.317449 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-774ebfe5-2d55-4313-8e00-469d210755f7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:17.322910 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-675fca12-2675-4b40-8b95-57bbb75a1f00 req-94e99b0a-3f7d-42ac-bbee-5b6bd51ca6c2 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:17.326079 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-675fca12-2675-4b40-8b95-57bbb75a1f00 req-94e99b0a-3f7d-42ac-bbee-5b6bd51ca6c2 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:17.351026 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-675fca12-2675-4b40-8b95-57bbb75a1f00 req-94e99b0a-3f7d-42ac-bbee-5b6bd51ca6c2 service nova] Creating event network-vif-deleted:bdb24e55-7862-4ad0-a43d-7830e3139255 for instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 on hv-cinder-83800 May 09 04:32:17.357544 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-675fca12-2675-4b40-8b95-57bbb75a1f00 req-94e99b0a-3f7d-42ac-bbee-5b6bd51ca6c2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082008 May 09 04:32:17.358560 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 428/873] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:17.419770 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-03d2121b-3093-498c-abfa-9ec706788b07 req-3656f4ad-53ef-4a3a-a29a-6e9ca114b86b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f5900f-cb8a-485d-866b-580b188cc09c", "name": "network-vif-plugged", "status": "completed", "tag": "374d080b-906f-4857-97aa-846916239632"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:17.449687 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-03d2121b-3093-498c-abfa-9ec706788b07 req-3656f4ad-53ef-4a3a-a29a-6e9ca114b86b service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:17.451770 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-03d2121b-3093-498c-abfa-9ec706788b07 req-3656f4ad-53ef-4a3a-a29a-6e9ca114b86b service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:17.480151 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-03d2121b-3093-498c-abfa-9ec706788b07 req-3656f4ad-53ef-4a3a-a29a-6e9ca114b86b service nova] Creating event network-vif-plugged:374d080b-906f-4857-97aa-846916239632 for instance 96f5900f-cb8a-485d-866b-580b188cc09c on hv-cinder-83800 May 09 04:32:17.497252 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-03d2121b-3093-498c-abfa-9ec706788b07 req-3656f4ad-53ef-4a3a-a29a-6e9ca114b86b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085834 May 09 04:32:17.498057 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 429/874] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:17.622452 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-774ebfe5-2d55-4313-8e00-469d210755f7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:17.633930 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-774ebfe5-2d55-4313-8e00-469d210755f7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:17.636269 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-774ebfe5-2d55-4313-8e00-469d210755f7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:17.637488 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-774ebfe5-2d55-4313-8e00-469d210755f7 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1739 microversion: 2.20 time: 0.347107 May 09 04:32:17.638357 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 446/875] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:17 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1739 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:17.864752 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4e6547da-6f62-452e-988f-3d80d934d29e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:17.864752 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4e6547da-6f62-452e-988f-3d80d934d29e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:17.874025 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4e6547da-6f62-452e-988f-3d80d934d29e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:17.877615 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4e6547da-6f62-452e-988f-3d80d934d29e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:17.877615 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4e6547da-6f62-452e-988f-3d80d934d29e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:17.877893 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4e6547da-6f62-452e-988f-3d80d934d29e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:17.965256 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4e6547da-6f62-452e-988f-3d80d934d29e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:17.975151 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4e6547da-6f62-452e-988f-3d80d934d29e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1612 microversion: 2.1 time: 0.119120 May 09 04:32:17.983988 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 430/876] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:17 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1612 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:18.656468 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-faf88955-0c8b-40a6-8488-9c841c1c6947 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:18.657679 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-faf88955-0c8b-40a6-8488-9c841c1c6947 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:18.664459 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-faf88955-0c8b-40a6-8488-9c841c1c6947 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:18.664906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-faf88955-0c8b-40a6-8488-9c841c1c6947 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:18.665840 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-faf88955-0c8b-40a6-8488-9c841c1c6947 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:18.667262 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-faf88955-0c8b-40a6-8488-9c841c1c6947 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:18.810098 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-faf88955-0c8b-40a6-8488-9c841c1c6947 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:18.818371 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-faf88955-0c8b-40a6-8488-9c841c1c6947 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:18.820069 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-faf88955-0c8b-40a6-8488-9c841c1c6947 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:18.821332 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-faf88955-0c8b-40a6-8488-9c841c1c6947 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1739 microversion: 2.20 time: 0.168826 May 09 04:32:18.821924 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 447/877] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:18 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:32:18.995173 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a9e31807-be2f-48f8-b113-a0a4e27b4824 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:18.995933 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a9e31807-be2f-48f8-b113-a0a4e27b4824 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:19.008129 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9e31807-be2f-48f8-b113-a0a4e27b4824 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:19.008574 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9e31807-be2f-48f8-b113-a0a4e27b4824 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:19.009378 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9e31807-be2f-48f8-b113-a0a4e27b4824 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:19.010390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9e31807-be2f-48f8-b113-a0a4e27b4824 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:19.051766 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9e31807-be2f-48f8-b113-a0a4e27b4824 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:19.052492 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9e31807-be2f-48f8-b113-a0a4e27b4824 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:19.053088 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-a9e31807-be2f-48f8-b113-a0a4e27b4824 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lazy-loading 'fault' on Instance uuid 8206836d-7fa2-48b8-8d4c-46c70608a3e0 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:32:19.109517 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a9e31807-be2f-48f8-b113-a0a4e27b4824 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:19.118402 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a9e31807-be2f-48f8-b113-a0a4e27b4824 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 200 len: 1329 microversion: 2.1 time: 0.127473 May 09 04:32:19.119075 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 431/878] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:18 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 1329 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:19.841987 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b41a370a-b4d6-4e21-a9e1-fe860aff0263 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:19.843167 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b41a370a-b4d6-4e21-a9e1-fe860aff0263 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:19.856924 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b41a370a-b4d6-4e21-a9e1-fe860aff0263 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:19.857630 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b41a370a-b4d6-4e21-a9e1-fe860aff0263 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:19.858422 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b41a370a-b4d6-4e21-a9e1-fe860aff0263 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:19.859008 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b41a370a-b4d6-4e21-a9e1-fe860aff0263 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:20.032368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b41a370a-b4d6-4e21-a9e1-fe860aff0263 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:20.041921 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b41a370a-b4d6-4e21-a9e1-fe860aff0263 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:20.043457 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b41a370a-b4d6-4e21-a9e1-fe860aff0263 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:20.044708 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b41a370a-b4d6-4e21-a9e1-fe860aff0263 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1739 microversion: 2.20 time: 0.207615 May 09 04:32:20.045273 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 448/879] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:19 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:32:20.142319 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-540500b5-7e9d-4450-9dc2-0cd1ffb79b91 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:20.143644 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-540500b5-7e9d-4450-9dc2-0cd1ffb79b91 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:20.154269 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-540500b5-7e9d-4450-9dc2-0cd1ffb79b91 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:20.155686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-540500b5-7e9d-4450-9dc2-0cd1ffb79b91 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:20.156576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-540500b5-7e9d-4450-9dc2-0cd1ffb79b91 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:20.156922 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-540500b5-7e9d-4450-9dc2-0cd1ffb79b91 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:20.182436 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-540500b5-7e9d-4450-9dc2-0cd1ffb79b91 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] HTTP exception thrown: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-540500b5-7e9d-4450-9dc2-0cd1ffb79b91 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Request method failure captured: May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 HTTP/1.1 May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJhTbCVgTT3HZuxvtZpJ_cLiO-p5aO5ZCrkaJhYtCXNfzo_IXS3499vPTrl-cgrMt-SnaVL5V4wtRTXaaPRZskqvbSNvwlk-mrGJOcozoTU2E5zQ45dYOd-AEzlNKKX4qka08Rdzwq7NFgcZCZDko0TOyv7hyBbf4It5Ltr84wDaqIk May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:32:20.184305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:32:20.185624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:32:20.185624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-AttachVolumeNegativeTest-70527954 May 09 04:32:20.185624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:32:20.185624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:32:20.185624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:32:20.185624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:32:20.185624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:32:20.185624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: c56a403eeee84720ba765e2d4367df74 May 09 04:32:20.185624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:32:20.185624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:32:20.185624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:32:20.185624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '8206836d-7fa2-48b8-8d4c-46c70608a3e0'} May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:32:20.186329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:32:20.187491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:32:20.188558 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-540500b5-7e9d-4450-9dc2-0cd1ffb79b91 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Returning 404 to user: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:32:20.188558 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-540500b5-7e9d-4450-9dc2-0cd1ffb79b91 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 404 len: 111 microversion: 2.1 time: 0.049549 May 09 04:32:20.189835 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 432/880] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:20 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:32:20.194773 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5d206175-e27d-4775-b82e-2b216bdd68ad tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '.version_select at 0x7fbfd97c0af0>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:20.227146 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5d206175-e27d-4775-b82e-2b216bdd68ad tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-475203447" status: 202 len: 0 microversion: 2.1 time: 0.032493 May 09 04:32:20.231493 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 449/881] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 9 04:32:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-475203447 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:32:21.072005 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8126dcd4-73c5-4379-ba5a-190dbfc755b1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Action: 'create', calling method: .version_select at 0x7fbfd44f2f70>, body: {"keypair": {"name": "tempest-keypair-727369245"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:21.072720 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5b1bc642-c218-4b1b-bb72-26368b320577 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:21.072811 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5b1bc642-c218-4b1b-bb72-26368b320577 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:21.082466 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b1bc642-c218-4b1b-bb72-26368b320577 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:21.082919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b1bc642-c218-4b1b-bb72-26368b320577 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:21.083884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b1bc642-c218-4b1b-bb72-26368b320577 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:21.084347 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5b1bc642-c218-4b1b-bb72-26368b320577 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:21.090568 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-8126dcd4-73c5-4379-ba5a-190dbfc755b1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:32:21.095708 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-8126dcd4-73c5-4379-ba5a-190dbfc755b1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for user c56a403eeee84720ba765e2d4367df74 and project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:32:21.263746 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5b1bc642-c218-4b1b-bb72-26368b320577 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:21.274133 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5b1bc642-c218-4b1b-bb72-26368b320577 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:21.276969 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5b1bc642-c218-4b1b-bb72-26368b320577 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:21.278417 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5b1bc642-c218-4b1b-bb72-26368b320577 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1739 microversion: 2.20 time: 0.216016 May 09 04:32:21.279194 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 433/882] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:21 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:21.491534 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-8126dcd4-73c5-4379-ba5a-190dbfc755b1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:32:21.498363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-8126dcd4-73c5-4379-ba5a-190dbfc755b1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for user c56a403eeee84720ba765e2d4367df74 and project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'key_pairs'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:32:21.513902 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8126dcd4-73c5-4379-ba5a-190dbfc755b1 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.446100 May 09 04:32:21.514501 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 450/883] 10.222.0.44 () {60 vars in 1157 bytes} [Mon May 9 04:32:21 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:22.300831 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fec789b8-4565-40b9-8451-2b4f2e2f71ff tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:22.308483 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fec789b8-4565-40b9-8451-2b4f2e2f71ff tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:22.326464 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fec789b8-4565-40b9-8451-2b4f2e2f71ff tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:22.327172 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fec789b8-4565-40b9-8451-2b4f2e2f71ff tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:22.328188 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fec789b8-4565-40b9-8451-2b4f2e2f71ff tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:22.328782 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fec789b8-4565-40b9-8451-2b4f2e2f71ff tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:22.613677 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fec789b8-4565-40b9-8451-2b4f2e2f71ff tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:22.623572 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fec789b8-4565-40b9-8451-2b4f2e2f71ff tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:22.625743 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fec789b8-4565-40b9-8451-2b4f2e2f71ff tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:22.627084 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fec789b8-4565-40b9-8451-2b4f2e2f71ff tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1739 microversion: 2.20 time: 0.332778 May 09 04:32:22.627779 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 434/884] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:22 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1739 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:23.191210 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1127846388", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cff1ca97-0d5c-4d7d-b3c2-a81f844b16da"}], "security_groups": [{"name": "tempest-securitygroup--1297486434"}], "key_name": "tempest-keypair-727369245", "user_data": "}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:23.350789 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.network.neutron [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] validate_networks() for [('cff1ca97-0d5c-4d7d-b3c2-a81f844b16da', None, None, None, None, None)] {{(pid=117033) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:32:23.645883 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-abb26a44-4a46-40c9-b1ae-1e45f2bbdce2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:23.646496 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-abb26a44-4a46-40c9-b1ae-1e45f2bbdce2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:23.661492 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-abb26a44-4a46-40c9-b1ae-1e45f2bbdce2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:23.662959 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-abb26a44-4a46-40c9-b1ae-1e45f2bbdce2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:23.663975 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-abb26a44-4a46-40c9-b1ae-1e45f2bbdce2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:23.664593 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-abb26a44-4a46-40c9-b1ae-1e45f2bbdce2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:23.827956 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Flavor limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:32:23.828381 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Image limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:32:23.828849 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Flavor pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:32:23.830271 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Image pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:32:23.830870 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:32:23.843866 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:23.844797 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:23.845813 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:23.846415 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:23.887785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:32:23.899220 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Getting quotas for user c56a403eeee84720ba765e2d4367df74 and project 9c83b0a8b88f452f9e12d077e8ac28c8. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:32:23.915590 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Going to run 1 instances... {{(pid=117033) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:32:23.920705 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:32:23.987468 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-aaa5eaa9-f5f4-47ff-897d-9bc86b4bd668 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.800670 May 09 04:32:23.994770 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 451/885] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:32:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:32:24.000368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-452be092-d1ad-4876-850c-d449815c4d43 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:24.001167 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-452be092-d1ad-4876-850c-d449815c4d43 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:24.056630 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-452be092-d1ad-4876-850c-d449815c4d43 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:24.063741 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-452be092-d1ad-4876-850c-d449815c4d43 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1241 microversion: 2.1 time: 0.067617 May 09 04:32:24.065201 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 452/886] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:23 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:24.092029 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-abb26a44-4a46-40c9-b1ae-1e45f2bbdce2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:24.101077 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-abb26a44-4a46-40c9-b1ae-1e45f2bbdce2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:24.103220 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-abb26a44-4a46-40c9-b1ae-1e45f2bbdce2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:24.105751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-abb26a44-4a46-40c9-b1ae-1e45f2bbdce2 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1739 microversion: 2.20 time: 0.463696 May 09 04:32:24.106475 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 435/887] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:23 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1739 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:25.082422 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-875079f3-71ec-4290-9f58-721d8b72ab07 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:25.083037 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-875079f3-71ec-4290-9f58-721d8b72ab07 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:25.102166 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-875079f3-71ec-4290-9f58-721d8b72ab07 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:25.102624 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-875079f3-71ec-4290-9f58-721d8b72ab07 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:25.107192 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-875079f3-71ec-4290-9f58-721d8b72ab07 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:25.109259 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-875079f3-71ec-4290-9f58-721d8b72ab07 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:25.125464 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3e33155e-4b15-49cc-a675-d936ba0064b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:25.126242 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3e33155e-4b15-49cc-a675-d936ba0064b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:25.135847 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e33155e-4b15-49cc-a675-d936ba0064b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:25.136694 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e33155e-4b15-49cc-a675-d936ba0064b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:25.137823 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e33155e-4b15-49cc-a675-d936ba0064b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:25.138577 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e33155e-4b15-49cc-a675-d936ba0064b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:25.208490 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-875079f3-71ec-4290-9f58-721d8b72ab07 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:25.223439 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-875079f3-71ec-4290-9f58-721d8b72ab07 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1301 microversion: 2.1 time: 0.144419 May 09 04:32:25.224413 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 453/888] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:25 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1301 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:25.426391 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3e33155e-4b15-49cc-a675-d936ba0064b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:25.482040 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3e33155e-4b15-49cc-a675-d936ba0064b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:25.484032 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3e33155e-4b15-49cc-a675-d936ba0064b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:25.485499 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3e33155e-4b15-49cc-a675-d936ba0064b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1739 microversion: 2.20 time: 0.365028 May 09 04:32:25.487282 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 436/889] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:25 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1739 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:26.247874 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-fc247372-5b11-49ea-a90e-9d5a060cf0ca tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:26.250154 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-fc247372-5b11-49ea-a90e-9d5a060cf0ca tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:26.262640 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fc247372-5b11-49ea-a90e-9d5a060cf0ca tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:26.263392 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fc247372-5b11-49ea-a90e-9d5a060cf0ca tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:26.264582 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fc247372-5b11-49ea-a90e-9d5a060cf0ca tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:26.265208 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fc247372-5b11-49ea-a90e-9d5a060cf0ca tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:26.442492 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-fc247372-5b11-49ea-a90e-9d5a060cf0ca tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:26.452670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-fc247372-5b11-49ea-a90e-9d5a060cf0ca tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1367 microversion: 2.1 time: 0.211191 May 09 04:32:26.454247 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 454/890] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:26 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:26.509002 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b8929a6b-a452-46cd-895d-cc7b83f95c4a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:26.511010 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b8929a6b-a452-46cd-895d-cc7b83f95c4a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:26.518541 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b8929a6b-a452-46cd-895d-cc7b83f95c4a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:26.519388 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b8929a6b-a452-46cd-895d-cc7b83f95c4a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:26.520507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b8929a6b-a452-46cd-895d-cc7b83f95c4a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:26.521193 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b8929a6b-a452-46cd-895d-cc7b83f95c4a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:26.745281 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b8929a6b-a452-46cd-895d-cc7b83f95c4a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:26.755116 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b8929a6b-a452-46cd-895d-cc7b83f95c4a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:26.757112 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b8929a6b-a452-46cd-895d-cc7b83f95c4a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:26.758495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b8929a6b-a452-46cd-895d-cc7b83f95c4a tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1739 microversion: 2.20 time: 0.253513 May 09 04:32:26.765719 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 437/891] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:26 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1739 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:27.345311 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-30b0f0a7-df60-4b4d-9e56-288311640b2e req-5865417f-c87e-41bb-96e0-e4caaac58ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac02e597-eed8-41a5-9300-f980ce0cf328", "tag": "114b3c19-9453-4537-b992-5d2737a6d6f4"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:27.360563 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-30b0f0a7-df60-4b4d-9e56-288311640b2e req-5865417f-c87e-41bb-96e0-e4caaac58ca1 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:27.361011 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-30b0f0a7-df60-4b4d-9e56-288311640b2e req-5865417f-c87e-41bb-96e0-e4caaac58ca1 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:27.376839 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-30b0f0a7-df60-4b4d-9e56-288311640b2e req-5865417f-c87e-41bb-96e0-e4caaac58ca1 service nova] Creating event network-changed:114b3c19-9453-4537-b992-5d2737a6d6f4 for instance ac02e597-eed8-41a5-9300-f980ce0cf328 on hv-cinder-83800 May 09 04:32:27.382953 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-30b0f0a7-df60-4b4d-9e56-288311640b2e req-5865417f-c87e-41bb-96e0-e4caaac58ca1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042283 May 09 04:32:27.383661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 455/892] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:27.471967 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-43c3d462-313a-4c1b-8ee2-4c6d7bad7bfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:27.473107 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-43c3d462-313a-4c1b-8ee2-4c6d7bad7bfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:27.483003 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43c3d462-313a-4c1b-8ee2-4c6d7bad7bfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:27.483584 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43c3d462-313a-4c1b-8ee2-4c6d7bad7bfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:27.484594 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43c3d462-313a-4c1b-8ee2-4c6d7bad7bfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:27.485240 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43c3d462-313a-4c1b-8ee2-4c6d7bad7bfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:27.780012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-efb832d4-a893-4c68-8db3-9050904822f3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:27.780757 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-efb832d4-a893-4c68-8db3-9050904822f3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:27.787008 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-efb832d4-a893-4c68-8db3-9050904822f3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:27.787451 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-efb832d4-a893-4c68-8db3-9050904822f3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:27.788491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-efb832d4-a893-4c68-8db3-9050904822f3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:27.788925 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-efb832d4-a893-4c68-8db3-9050904822f3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:27.860441 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-43c3d462-313a-4c1b-8ee2-4c6d7bad7bfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:27.868756 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-43c3d462-313a-4c1b-8ee2-4c6d7bad7bfb tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1367 microversion: 2.1 time: 0.401942 May 09 04:32:27.870295 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 438/893] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:27 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:27.924871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-efb832d4-a893-4c68-8db3-9050904822f3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:27.933891 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-efb832d4-a893-4c68-8db3-9050904822f3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:27.935405 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-efb832d4-a893-4c68-8db3-9050904822f3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:27.936637 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-efb832d4-a893-4c68-8db3-9050904822f3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1721 microversion: 2.20 time: 0.162804 May 09 04:32:27.937586 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 456/894] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:27 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:32:28.886761 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8dae981c-b2aa-480c-a4b9-e79bd6907d1c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:28.887487 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8dae981c-b2aa-480c-a4b9-e79bd6907d1c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:28.894101 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8dae981c-b2aa-480c-a4b9-e79bd6907d1c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:28.894546 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8dae981c-b2aa-480c-a4b9-e79bd6907d1c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:28.895310 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8dae981c-b2aa-480c-a4b9-e79bd6907d1c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:28.895735 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8dae981c-b2aa-480c-a4b9-e79bd6907d1c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:28.955852 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1ff8c14b-4709-4067-9ddf-b6014342aa47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:28.956584 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1ff8c14b-4709-4067-9ddf-b6014342aa47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:28.967879 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1ff8c14b-4709-4067-9ddf-b6014342aa47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:28.968363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1ff8c14b-4709-4067-9ddf-b6014342aa47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:28.969145 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1ff8c14b-4709-4067-9ddf-b6014342aa47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:28.969726 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1ff8c14b-4709-4067-9ddf-b6014342aa47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:29.067615 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8dae981c-b2aa-480c-a4b9-e79bd6907d1c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:29.076074 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8dae981c-b2aa-480c-a4b9-e79bd6907d1c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1367 microversion: 2.1 time: 0.193602 May 09 04:32:29.076650 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 439/895] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:28 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:29.081147 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f6929cfa-1fb7-48cf-b40d-83bfebbf9a01 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:29.081648 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f6929cfa-1fb7-48cf-b40d-83bfebbf9a01 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:29.089262 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6929cfa-1fb7-48cf-b40d-83bfebbf9a01 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:29.089703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6929cfa-1fb7-48cf-b40d-83bfebbf9a01 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:29.090469 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6929cfa-1fb7-48cf-b40d-83bfebbf9a01 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:29.090898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6929cfa-1fb7-48cf-b40d-83bfebbf9a01 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:29.111510 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1ff8c14b-4709-4067-9ddf-b6014342aa47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:29.113654 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f6929cfa-1fb7-48cf-b40d-83bfebbf9a01 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/ips" status: 200 len: 146 microversion: 2.1 time: 0.035990 May 09 04:32:29.114230 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 440/896] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 04:32:29 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:29.120699 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1ff8c14b-4709-4067-9ddf-b6014342aa47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:29.122213 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1ff8c14b-4709-4067-9ddf-b6014342aa47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:29.123386 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1ff8c14b-4709-4067-9ddf-b6014342aa47 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1721 microversion: 2.20 time: 0.171335 May 09 04:32:29.123962 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 457/897] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:28 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:30.093644 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a1d1ea98-0202-4671-ab59-88d2f2d2049b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:30.094195 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a1d1ea98-0202-4671-ab59-88d2f2d2049b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:30.100548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a1d1ea98-0202-4671-ab59-88d2f2d2049b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:30.100990 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a1d1ea98-0202-4671-ab59-88d2f2d2049b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:30.101738 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a1d1ea98-0202-4671-ab59-88d2f2d2049b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:30.102165 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a1d1ea98-0202-4671-ab59-88d2f2d2049b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:30.140973 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-22a5a5ee-cc9c-4e1c-a13d-e3471f893444 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:30.141580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-22a5a5ee-cc9c-4e1c-a13d-e3471f893444 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:30.148034 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-22a5a5ee-cc9c-4e1c-a13d-e3471f893444 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:30.148487 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-22a5a5ee-cc9c-4e1c-a13d-e3471f893444 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:30.149293 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-22a5a5ee-cc9c-4e1c-a13d-e3471f893444 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:30.149730 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-22a5a5ee-cc9c-4e1c-a13d-e3471f893444 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:30.234559 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a1d1ea98-0202-4671-ab59-88d2f2d2049b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:30.242106 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a1d1ea98-0202-4671-ab59-88d2f2d2049b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1367 microversion: 2.1 time: 0.152421 May 09 04:32:30.242677 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 441/898] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:30 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:30.280210 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-22a5a5ee-cc9c-4e1c-a13d-e3471f893444 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:30.288022 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-22a5a5ee-cc9c-4e1c-a13d-e3471f893444 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:30.289523 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-22a5a5ee-cc9c-4e1c-a13d-e3471f893444 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:30.290670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-22a5a5ee-cc9c-4e1c-a13d-e3471f893444 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1721 microversion: 2.20 time: 0.153613 May 09 04:32:30.291295 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 458/899] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:30 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:32:31.258435 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ec155c9b-e088-4fd7-85b2-8e5e0b4a1300 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:31.259038 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ec155c9b-e088-4fd7-85b2-8e5e0b4a1300 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:31.265745 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec155c9b-e088-4fd7-85b2-8e5e0b4a1300 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:31.266126 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec155c9b-e088-4fd7-85b2-8e5e0b4a1300 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:31.266876 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec155c9b-e088-4fd7-85b2-8e5e0b4a1300 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:31.267307 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec155c9b-e088-4fd7-85b2-8e5e0b4a1300 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:31.309610 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-00063dbe-d0d2-408f-b12f-5df8c4c4fe58 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:31.310217 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-00063dbe-d0d2-408f-b12f-5df8c4c4fe58 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:31.316533 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-00063dbe-d0d2-408f-b12f-5df8c4c4fe58 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:31.316978 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-00063dbe-d0d2-408f-b12f-5df8c4c4fe58 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:31.317733 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-00063dbe-d0d2-408f-b12f-5df8c4c4fe58 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:31.318166 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-00063dbe-d0d2-408f-b12f-5df8c4c4fe58 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:31.396909 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ec155c9b-e088-4fd7-85b2-8e5e0b4a1300 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:31.404801 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ec155c9b-e088-4fd7-85b2-8e5e0b4a1300 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1367 microversion: 2.1 time: 0.150174 May 09 04:32:31.405366 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 442/900] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:31 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:31.444945 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-00063dbe-d0d2-408f-b12f-5df8c4c4fe58 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:31.453406 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-00063dbe-d0d2-408f-b12f-5df8c4c4fe58 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:31.454918 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-00063dbe-d0d2-408f-b12f-5df8c4c4fe58 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:31.456111 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-00063dbe-d0d2-408f-b12f-5df8c4c4fe58 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1721 microversion: 2.20 time: 0.151233 May 09 04:32:31.456666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 459/901] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:31 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:32:31.918579 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-aac4e20f-05ed-4d7c-9b62-f773478ca6ba req-cdd3a553-c31e-48c5-9cea-8f72c1759e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f5900f-cb8a-485d-866b-580b188cc09c", "name": "network-vif-unplugged", "status": "completed", "tag": "374d080b-906f-4857-97aa-846916239632"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:31.926376 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-aac4e20f-05ed-4d7c-9b62-f773478ca6ba req-cdd3a553-c31e-48c5-9cea-8f72c1759e05 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:31.926821 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-aac4e20f-05ed-4d7c-9b62-f773478ca6ba req-cdd3a553-c31e-48c5-9cea-8f72c1759e05 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:31.951095 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-aac4e20f-05ed-4d7c-9b62-f773478ca6ba req-cdd3a553-c31e-48c5-9cea-8f72c1759e05 service nova] Creating event network-vif-unplugged:374d080b-906f-4857-97aa-846916239632 for instance 96f5900f-cb8a-485d-866b-580b188cc09c on hv-cinder-83800 May 09 04:32:31.958433 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-aac4e20f-05ed-4d7c-9b62-f773478ca6ba req-cdd3a553-c31e-48c5-9cea-8f72c1759e05 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043868 May 09 04:32:31.959791 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 443/902] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:32.423562 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8235a0ed-670c-4723-a220-cadac330d437 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:32.424922 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8235a0ed-670c-4723-a220-cadac330d437 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:32.444460 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8235a0ed-670c-4723-a220-cadac330d437 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:32.444933 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8235a0ed-670c-4723-a220-cadac330d437 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:32.445729 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8235a0ed-670c-4723-a220-cadac330d437 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:32.446169 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8235a0ed-670c-4723-a220-cadac330d437 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:32.478388 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c179c0db-365f-45d9-8f18-aa280035137d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:32.480316 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c179c0db-365f-45d9-8f18-aa280035137d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:32.487856 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c179c0db-365f-45d9-8f18-aa280035137d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:32.489515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c179c0db-365f-45d9-8f18-aa280035137d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:32.490491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c179c0db-365f-45d9-8f18-aa280035137d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:32.494706 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c179c0db-365f-45d9-8f18-aa280035137d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:32.632278 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8235a0ed-670c-4723-a220-cadac330d437 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:32.640839 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8235a0ed-670c-4723-a220-cadac330d437 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1367 microversion: 2.1 time: 0.221985 May 09 04:32:32.641423 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 460/903] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:32 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:32.646937 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-fe29d340-58cf-412a-a864-c783dbe5a8ad tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1ada3cb-a5ad-4a9d-b78e-fc4908a0ca60"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:32.648269 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-fe29d340-58cf-412a-a864-c783dbe5a8ad tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:32.655100 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fe29d340-58cf-412a-a864-c783dbe5a8ad tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:32.655528 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fe29d340-58cf-412a-a864-c783dbe5a8ad tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:32.656336 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fe29d340-58cf-412a-a864-c783dbe5a8ad tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:32.656781 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fe29d340-58cf-412a-a864-c783dbe5a8ad tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:32.688979 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c179c0db-365f-45d9-8f18-aa280035137d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:32.696705 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c179c0db-365f-45d9-8f18-aa280035137d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:32.698355 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c179c0db-365f-45d9-8f18-aa280035137d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:32.699500 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c179c0db-365f-45d9-8f18-aa280035137d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1664 microversion: 2.20 time: 0.227726 May 09 04:32:32.700073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 444/904] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:32 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1664 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:32:32.716979 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3fb729b7-ba8d-43aa-900a-8377d08659e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ec8cd3c-851c-4ec7-a6b1-9521c419a8d6"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:32.718020 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3fb729b7-ba8d-43aa-900a-8377d08659e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:32.724934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3fb729b7-ba8d-43aa-900a-8377d08659e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:32.725379 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3fb729b7-ba8d-43aa-900a-8377d08659e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:32.726137 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3fb729b7-ba8d-43aa-900a-8377d08659e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:32.726568 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3fb729b7-ba8d-43aa-900a-8377d08659e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:32.910136 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-fe29d340-58cf-412a-a864-c783dbe5a8ad tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "POST /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267295 May 09 04:32:32.911185 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 461/905] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 04:32:32 2022] POST /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:33.009606 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3fb729b7-ba8d-43aa-900a-8377d08659e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "POST /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296544 May 09 04:32:33.010293 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 445/906] 10.222.0.44 () {62 vars in 1363 bytes} [Mon May 9 04:32:32 2022] POST /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 04:32:33.127601 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-fde26f8d-ed50-4f22-a749-6b95d88176da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:33.128130 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-fde26f8d-ed50-4f22-a749-6b95d88176da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:33.135064 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fde26f8d-ed50-4f22-a749-6b95d88176da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:33.135513 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fde26f8d-ed50-4f22-a749-6b95d88176da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:33.136311 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fde26f8d-ed50-4f22-a749-6b95d88176da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:33.136747 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-fde26f8d-ed50-4f22-a749-6b95d88176da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:33.368883 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-fde26f8d-ed50-4f22-a749-6b95d88176da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "DELETE /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c/os-volume_attachments/3ec8cd3c-851c-4ec7-a6b1-9521c419a8d6" status: 202 len: 0 microversion: 2.20 time: 0.245654 May 09 04:32:33.369511 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 462/907] 10.222.0.44 () {60 vars in 1456 bytes} [Mon May 9 04:32:33 2022] DELETE /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c/os-volume_attachments/3ec8cd3c-851c-4ec7-a6b1-9521c419a8d6 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 04:32:33.431850 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-acd233d6-6a2d-454e-8dee-577bfcd460e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:33.432755 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-acd233d6-6a2d-454e-8dee-577bfcd460e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:33.439651 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-acd233d6-6a2d-454e-8dee-577bfcd460e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:33.440130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-acd233d6-6a2d-454e-8dee-577bfcd460e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:33.440907 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-acd233d6-6a2d-454e-8dee-577bfcd460e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:33.441342 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-acd233d6-6a2d-454e-8dee-577bfcd460e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:33.522922 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-acd233d6-6a2d-454e-8dee-577bfcd460e9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "POST /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c/action" status: 202 len: 0 microversion: 2.20 time: 0.095262 May 09 04:32:33.525158 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 446/908] 10.222.0.44 () {62 vars in 1318 bytes} [Mon May 9 04:32:33 2022] POST /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 04:32:33.533563 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d59724b9-c36c-4ca0-8fc6-dab53006f365 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:33.535135 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d59724b9-c36c-4ca0-8fc6-dab53006f365 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:33.542475 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d59724b9-c36c-4ca0-8fc6-dab53006f365 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:33.543321 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d59724b9-c36c-4ca0-8fc6-dab53006f365 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:33.544286 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d59724b9-c36c-4ca0-8fc6-dab53006f365 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:33.544911 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d59724b9-c36c-4ca0-8fc6-dab53006f365 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:33.657601 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f68d592a-3b62-4f79-ad13-3d6cd1e8d5a6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:33.658532 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f68d592a-3b62-4f79-ad13-3d6cd1e8d5a6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:33.664691 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f68d592a-3b62-4f79-ad13-3d6cd1e8d5a6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:33.665246 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f68d592a-3b62-4f79-ad13-3d6cd1e8d5a6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:33.666885 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f68d592a-3b62-4f79-ad13-3d6cd1e8d5a6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:33.667562 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f68d592a-3b62-4f79-ad13-3d6cd1e8d5a6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:33.701531 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d59724b9-c36c-4ca0-8fc6-dab53006f365 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:33.709681 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d59724b9-c36c-4ca0-8fc6-dab53006f365 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:33.711194 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d59724b9-c36c-4ca0-8fc6-dab53006f365 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:33.713462 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d59724b9-c36c-4ca0-8fc6-dab53006f365 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1672 microversion: 2.20 time: 0.183739 May 09 04:32:33.714379 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 463/909] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:33 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:32:33.840768 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f68d592a-3b62-4f79-ad13-3d6cd1e8d5a6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:33.849502 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f68d592a-3b62-4f79-ad13-3d6cd1e8d5a6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1367 microversion: 2.1 time: 0.195787 May 09 04:32:33.850099 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 447/910] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:33 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:32:33.987920 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-9b70a3a8-b1c1-4bb0-b67f-5d9dcba3d9ac req-b81f5291-eaa1-403e-a589-423b9bb8ee75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac02e597-eed8-41a5-9300-f980ce0cf328", "name": "network-vif-plugged", "status": "completed", "tag": "114b3c19-9453-4537-b992-5d2737a6d6f4"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:33.996252 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-9b70a3a8-b1c1-4bb0-b67f-5d9dcba3d9ac req-b81f5291-eaa1-403e-a589-423b9bb8ee75 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:33.996700 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-9b70a3a8-b1c1-4bb0-b67f-5d9dcba3d9ac req-b81f5291-eaa1-403e-a589-423b9bb8ee75 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:34.007719 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-9b70a3a8-b1c1-4bb0-b67f-5d9dcba3d9ac req-b81f5291-eaa1-403e-a589-423b9bb8ee75 service nova] Creating event network-vif-plugged:114b3c19-9453-4537-b992-5d2737a6d6f4 for instance ac02e597-eed8-41a5-9300-f980ce0cf328 on hv-cinder-83800 May 09 04:32:34.013055 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-9b70a3a8-b1c1-4bb0-b67f-5d9dcba3d9ac req-b81f5291-eaa1-403e-a589-423b9bb8ee75 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029037 May 09 04:32:34.013839 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 464/911] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:34.734383 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ec861a48-c2fd-40e1-9035-35b9c789b255 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:34.735007 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ec861a48-c2fd-40e1-9035-35b9c789b255 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:34.746191 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec861a48-c2fd-40e1-9035-35b9c789b255 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:34.746631 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec861a48-c2fd-40e1-9035-35b9c789b255 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:34.747411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec861a48-c2fd-40e1-9035-35b9c789b255 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:34.747851 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec861a48-c2fd-40e1-9035-35b9c789b255 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:34.867998 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-85a6903a-afe2-443f-aad5-d1db2460cd57 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:34.868712 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-85a6903a-afe2-443f-aad5-d1db2460cd57 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:34.876995 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-85a6903a-afe2-443f-aad5-d1db2460cd57 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:34.877746 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-85a6903a-afe2-443f-aad5-d1db2460cd57 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:34.879101 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-85a6903a-afe2-443f-aad5-d1db2460cd57 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:34.879779 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-85a6903a-afe2-443f-aad5-d1db2460cd57 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:34.881165 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ec861a48-c2fd-40e1-9035-35b9c789b255 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:34.892473 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ec861a48-c2fd-40e1-9035-35b9c789b255 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:34.894134 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ec861a48-c2fd-40e1-9035-35b9c789b255 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:34.895695 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ec861a48-c2fd-40e1-9035-35b9c789b255 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.165697 May 09 04:32:34.896700 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 448/912] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:34 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:35.024545 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-85a6903a-afe2-443f-aad5-d1db2460cd57 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:35.032407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-85a6903a-afe2-443f-aad5-d1db2460cd57 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1367 microversion: 2.1 time: 0.169128 May 09 04:32:35.033109 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 465/913] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:34 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:32:35.922793 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c6af7a30-30f2-47b5-a4eb-7b602e253c18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:35.923409 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c6af7a30-30f2-47b5-a4eb-7b602e253c18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:35.935295 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6af7a30-30f2-47b5-a4eb-7b602e253c18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:35.935844 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6af7a30-30f2-47b5-a4eb-7b602e253c18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:35.936677 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6af7a30-30f2-47b5-a4eb-7b602e253c18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:35.937106 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6af7a30-30f2-47b5-a4eb-7b602e253c18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:36.052407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-af8e91ab-484c-41b4-abee-5648a3b21989 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:36.053125 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-af8e91ab-484c-41b4-abee-5648a3b21989 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:36.059541 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-af8e91ab-484c-41b4-abee-5648a3b21989 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:36.060026 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-af8e91ab-484c-41b4-abee-5648a3b21989 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:36.060797 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-af8e91ab-484c-41b4-abee-5648a3b21989 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:36.061230 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-af8e91ab-484c-41b4-abee-5648a3b21989 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:36.196132 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c6af7a30-30f2-47b5-a4eb-7b602e253c18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:36.204588 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-af8e91ab-484c-41b4-abee-5648a3b21989 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:36.209700 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c6af7a30-30f2-47b5-a4eb-7b602e253c18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:36.211274 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c6af7a30-30f2-47b5-a4eb-7b602e253c18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:36.212346 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-af8e91ab-484c-41b4-abee-5648a3b21989 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1556 microversion: 2.1 time: 0.163671 May 09 04:32:36.212964 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 466/914] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:32:36 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:32:36.215307 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c6af7a30-30f2-47b5-a4eb-7b602e253c18 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.304406 May 09 04:32:36.219941 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 449/915] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:35 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:36.228956 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-92a7b051-b1e0-4539-ba99-d7a53b945be4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:36.229450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-92a7b051-b1e0-4539-ba99-d7a53b945be4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:36.235554 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-92a7b051-b1e0-4539-ba99-d7a53b945be4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:36.236047 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-92a7b051-b1e0-4539-ba99-d7a53b945be4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:36.236814 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-92a7b051-b1e0-4539-ba99-d7a53b945be4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:36.237245 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-92a7b051-b1e0-4539-ba99-d7a53b945be4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:36.328023 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-92a7b051-b1e0-4539-ba99-d7a53b945be4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102745 May 09 04:32:36.328766 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 467/916] 10.222.0.44 () {58 vars in 1274 bytes} [Mon May 9 04:32:36 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:37.234555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ace8c556-54c5-452f-8528-d06d1474f3da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:37.236206 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ace8c556-54c5-452f-8528-d06d1474f3da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:37.247761 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ace8c556-54c5-452f-8528-d06d1474f3da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:37.248556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ace8c556-54c5-452f-8528-d06d1474f3da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:37.251677 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ace8c556-54c5-452f-8528-d06d1474f3da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:37.252829 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ace8c556-54c5-452f-8528-d06d1474f3da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:37.485164 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ace8c556-54c5-452f-8528-d06d1474f3da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:37.495884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ace8c556-54c5-452f-8528-d06d1474f3da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:37.497772 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ace8c556-54c5-452f-8528-d06d1474f3da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:37.499137 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ace8c556-54c5-452f-8528-d06d1474f3da tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.269514 May 09 04:32:37.511309 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 450/917] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:37 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:38.331815 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-1784f29c-c73c-45b2-90b7-632d15183c6b req-cea1d0f4-a934-4ce2-8dcb-82bb9b86095b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac02e597-eed8-41a5-9300-f980ce0cf328", "tag": "114b3c19-9453-4537-b992-5d2737a6d6f4"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:38.343746 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-1784f29c-c73c-45b2-90b7-632d15183c6b req-cea1d0f4-a934-4ce2-8dcb-82bb9b86095b service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:38.346983 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-1784f29c-c73c-45b2-90b7-632d15183c6b req-cea1d0f4-a934-4ce2-8dcb-82bb9b86095b service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:38.374219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-1784f29c-c73c-45b2-90b7-632d15183c6b req-cea1d0f4-a934-4ce2-8dcb-82bb9b86095b service nova] Creating event network-changed:114b3c19-9453-4537-b992-5d2737a6d6f4 for instance ac02e597-eed8-41a5-9300-f980ce0cf328 on hv-cinder-83800 May 09 04:32:38.383528 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-1784f29c-c73c-45b2-90b7-632d15183c6b req-cea1d0f4-a934-4ce2-8dcb-82bb9b86095b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249001 May 09 04:32:38.397074 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 468/918] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:38.527789 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-190ac66a-a3a0-4b5b-aeea-c319b5509504 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:38.528592 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-190ac66a-a3a0-4b5b-aeea-c319b5509504 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:38.539161 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-190ac66a-a3a0-4b5b-aeea-c319b5509504 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:38.540069 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-190ac66a-a3a0-4b5b-aeea-c319b5509504 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:38.541625 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-190ac66a-a3a0-4b5b-aeea-c319b5509504 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:38.542279 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-190ac66a-a3a0-4b5b-aeea-c319b5509504 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:38.799728 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-190ac66a-a3a0-4b5b-aeea-c319b5509504 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:38.817378 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-190ac66a-a3a0-4b5b-aeea-c319b5509504 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:38.829714 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-190ac66a-a3a0-4b5b-aeea-c319b5509504 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:38.831326 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-190ac66a-a3a0-4b5b-aeea-c319b5509504 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.316528 May 09 04:32:38.843565 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 451/919] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:38 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:39.851546 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4a649907-ea1e-4890-8b35-03f99dfeee43 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:39.852280 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-4a649907-ea1e-4890-8b35-03f99dfeee43 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:39.860270 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4a649907-ea1e-4890-8b35-03f99dfeee43 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:39.860965 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4a649907-ea1e-4890-8b35-03f99dfeee43 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:39.861783 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4a649907-ea1e-4890-8b35-03f99dfeee43 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:39.862222 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4a649907-ea1e-4890-8b35-03f99dfeee43 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:40.012978 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4a649907-ea1e-4890-8b35-03f99dfeee43 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:40.021057 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4a649907-ea1e-4890-8b35-03f99dfeee43 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:40.022550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4a649907-ea1e-4890-8b35-03f99dfeee43 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:40.023714 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-4a649907-ea1e-4890-8b35-03f99dfeee43 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.176600 May 09 04:32:40.024301 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 469/920] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:39 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:41.043536 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2ab0b907-ec24-4158-931b-323f16648c2d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:41.044145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2ab0b907-ec24-4158-931b-323f16648c2d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:41.055151 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2ab0b907-ec24-4158-931b-323f16648c2d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:41.055732 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2ab0b907-ec24-4158-931b-323f16648c2d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:41.056734 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2ab0b907-ec24-4158-931b-323f16648c2d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:41.057721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2ab0b907-ec24-4158-931b-323f16648c2d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:41.202584 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2ab0b907-ec24-4158-931b-323f16648c2d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:41.211004 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2ab0b907-ec24-4158-931b-323f16648c2d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:41.213305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2ab0b907-ec24-4158-931b-323f16648c2d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:41.214975 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2ab0b907-ec24-4158-931b-323f16648c2d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.176203 May 09 04:32:41.215552 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 452/921] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:41 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:42.234325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-924c49bd-6a61-4ae9-84e1-159920f34f41 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:42.234956 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-924c49bd-6a61-4ae9-84e1-159920f34f41 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:42.242005 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-924c49bd-6a61-4ae9-84e1-159920f34f41 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:42.242551 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-924c49bd-6a61-4ae9-84e1-159920f34f41 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:42.243527 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-924c49bd-6a61-4ae9-84e1-159920f34f41 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:42.244527 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-924c49bd-6a61-4ae9-84e1-159920f34f41 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:42.400978 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-924c49bd-6a61-4ae9-84e1-159920f34f41 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:42.413443 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-924c49bd-6a61-4ae9-84e1-159920f34f41 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:42.415337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-924c49bd-6a61-4ae9-84e1-159920f34f41 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:42.419190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-924c49bd-6a61-4ae9-84e1-159920f34f41 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.186792 May 09 04:32:42.419190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 470/922] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:42 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:43.442419 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-72f1bf4b-e2a1-4a1b-a978-963080a685b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:43.443405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-72f1bf4b-e2a1-4a1b-a978-963080a685b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:43.453607 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-72f1bf4b-e2a1-4a1b-a978-963080a685b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:43.454393 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-72f1bf4b-e2a1-4a1b-a978-963080a685b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:43.455285 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-72f1bf4b-e2a1-4a1b-a978-963080a685b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:43.455806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-72f1bf4b-e2a1-4a1b-a978-963080a685b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:43.656969 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-72f1bf4b-e2a1-4a1b-a978-963080a685b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:43.680915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-72f1bf4b-e2a1-4a1b-a978-963080a685b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:43.683533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-72f1bf4b-e2a1-4a1b-a978-963080a685b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:43.685056 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-72f1bf4b-e2a1-4a1b-a978-963080a685b5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.247329 May 09 04:32:43.696861 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 453/923] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:43 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:44.703269 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b26f92e2-b3f8-4ea9-9996-b25d5be1db06 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:44.704110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b26f92e2-b3f8-4ea9-9996-b25d5be1db06 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:44.711141 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b26f92e2-b3f8-4ea9-9996-b25d5be1db06 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:44.712726 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b26f92e2-b3f8-4ea9-9996-b25d5be1db06 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:44.714017 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b26f92e2-b3f8-4ea9-9996-b25d5be1db06 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:44.714461 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b26f92e2-b3f8-4ea9-9996-b25d5be1db06 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:44.923623 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b26f92e2-b3f8-4ea9-9996-b25d5be1db06 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:44.932551 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b26f92e2-b3f8-4ea9-9996-b25d5be1db06 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:44.934066 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b26f92e2-b3f8-4ea9-9996-b25d5be1db06 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:44.935245 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b26f92e2-b3f8-4ea9-9996-b25d5be1db06 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.236095 May 09 04:32:44.935807 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 471/924] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:44 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:45.972092 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4d32716b-89af-4797-8215-1c235a4d8822 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:45.990420 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4d32716b-89af-4797-8215-1c235a4d8822 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:46.043929 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d32716b-89af-4797-8215-1c235a4d8822 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:46.043929 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d32716b-89af-4797-8215-1c235a4d8822 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:46.043929 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d32716b-89af-4797-8215-1c235a4d8822 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:46.043929 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d32716b-89af-4797-8215-1c235a4d8822 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:46.187209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4d32716b-89af-4797-8215-1c235a4d8822 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:46.195195 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4d32716b-89af-4797-8215-1c235a4d8822 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:46.197212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4d32716b-89af-4797-8215-1c235a4d8822 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:46.206532 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4d32716b-89af-4797-8215-1c235a4d8822 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.251831 May 09 04:32:46.207108 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 454/925] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:45 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:47.226692 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-2a15bcf5-9912-45a1-a6c9-cde5d70772e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:47.229045 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-2a15bcf5-9912-45a1-a6c9-cde5d70772e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:47.236454 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2a15bcf5-9912-45a1-a6c9-cde5d70772e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:47.237034 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2a15bcf5-9912-45a1-a6c9-cde5d70772e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:47.238010 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2a15bcf5-9912-45a1-a6c9-cde5d70772e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:47.238540 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2a15bcf5-9912-45a1-a6c9-cde5d70772e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:47.393432 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-2a15bcf5-9912-45a1-a6c9-cde5d70772e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:47.402443 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-2a15bcf5-9912-45a1-a6c9-cde5d70772e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:47.404003 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-2a15bcf5-9912-45a1-a6c9-cde5d70772e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:47.405176 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-2a15bcf5-9912-45a1-a6c9-cde5d70772e3 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.182466 May 09 04:32:47.405747 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 472/926] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:47 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:48.031594 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e21e50d5-cff8-4684-bfec-05e00afe4d5d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:48.032616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e21e50d5-cff8-4684-bfec-05e00afe4d5d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:48.039018 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e21e50d5-cff8-4684-bfec-05e00afe4d5d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:48.039471 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e21e50d5-cff8-4684-bfec-05e00afe4d5d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:48.040268 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e21e50d5-cff8-4684-bfec-05e00afe4d5d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:48.041539 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e21e50d5-cff8-4684-bfec-05e00afe4d5d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:48.070646 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e21e50d5-cff8-4684-bfec-05e00afe4d5d tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042848 May 09 04:32:48.071201 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 455/927] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:32:48 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:48.081165 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e99a009f-fb9b-4062-bd15-d6f49235635b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:48.081669 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e99a009f-fb9b-4062-bd15-d6f49235635b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:48.088319 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e99a009f-fb9b-4062-bd15-d6f49235635b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:48.089053 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e99a009f-fb9b-4062-bd15-d6f49235635b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:48.089818 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e99a009f-fb9b-4062-bd15-d6f49235635b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:48.090259 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e99a009f-fb9b-4062-bd15-d6f49235635b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:48.119509 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e99a009f-fb9b-4062-bd15-d6f49235635b tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments/f1ada3cb-a5ad-4a9d-b78e-fc4908a0ca60" status: 200 len: 194 microversion: 2.1 time: 0.042205 May 09 04:32:48.120719 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 473/928] 10.222.0.44 () {58 vars in 1412 bytes} [Mon May 9 04:32:48 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments/f1ada3cb-a5ad-4a9d-b78e-fc4908a0ca60 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:48.423728 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ac574115-2bb6-41c2-82cb-3453c7153753 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:48.424434 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ac574115-2bb6-41c2-82cb-3453c7153753 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:48.430803 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ac574115-2bb6-41c2-82cb-3453c7153753 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:48.431645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ac574115-2bb6-41c2-82cb-3453c7153753 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:48.432555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ac574115-2bb6-41c2-82cb-3453c7153753 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:48.432977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ac574115-2bb6-41c2-82cb-3453c7153753 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:48.562053 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ac574115-2bb6-41c2-82cb-3453c7153753 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:48.571106 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ac574115-2bb6-41c2-82cb-3453c7153753 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:48.572992 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ac574115-2bb6-41c2-82cb-3453c7153753 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:48.574151 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ac574115-2bb6-41c2-82cb-3453c7153753 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.154489 May 09 04:32:48.574716 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 456/929] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:48 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:49.431544 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-59bf7af5-66bd-48d2-97d3-7af1c1f79bac tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9356e137-c778-4191-b72c-f3d483f9b3dd"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:49.432718 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-59bf7af5-66bd-48d2-97d3-7af1c1f79bac tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:49.439101 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-59bf7af5-66bd-48d2-97d3-7af1c1f79bac tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:49.439554 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-59bf7af5-66bd-48d2-97d3-7af1c1f79bac tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:49.440370 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-59bf7af5-66bd-48d2-97d3-7af1c1f79bac tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:49.440809 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-59bf7af5-66bd-48d2-97d3-7af1c1f79bac tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:49.593863 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6c697db8-813d-4eac-8179-22266b900b2b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:49.594508 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6c697db8-813d-4eac-8179-22266b900b2b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:49.601662 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c697db8-813d-4eac-8179-22266b900b2b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:49.602184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c697db8-813d-4eac-8179-22266b900b2b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:49.603023 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c697db8-813d-4eac-8179-22266b900b2b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:49.604119 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c697db8-813d-4eac-8179-22266b900b2b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:49.708024 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-59bf7af5-66bd-48d2-97d3-7af1c1f79bac tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "POST /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279419 May 09 04:32:49.711726 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 474/930] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 04:32:49 2022] POST /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:49.767670 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6c697db8-813d-4eac-8179-22266b900b2b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:49.778123 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6c697db8-813d-4eac-8179-22266b900b2b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:49.779932 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6c697db8-813d-4eac-8179-22266b900b2b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:49.782259 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6c697db8-813d-4eac-8179-22266b900b2b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.192529 May 09 04:32:49.783050 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 457/931] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:49 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 04:32:50.804345 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-72d80b75-91cc-4f38-80d7-68a54354cf3d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:50.804345 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-72d80b75-91cc-4f38-80d7-68a54354cf3d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:50.811453 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-72d80b75-91cc-4f38-80d7-68a54354cf3d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:50.811933 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-72d80b75-91cc-4f38-80d7-68a54354cf3d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:50.812744 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-72d80b75-91cc-4f38-80d7-68a54354cf3d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:50.813185 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-72d80b75-91cc-4f38-80d7-68a54354cf3d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:50.949006 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-72d80b75-91cc-4f38-80d7-68a54354cf3d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:50.957174 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-72d80b75-91cc-4f38-80d7-68a54354cf3d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:50.958664 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-72d80b75-91cc-4f38-80d7-68a54354cf3d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:50.959823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-72d80b75-91cc-4f38-80d7-68a54354cf3d tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.162654 May 09 04:32:50.960471 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 475/932] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:50 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:51.282762 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-20e834ec-df2e-46eb-b786-c4cfd85f1595 req-afe58f8f-ca65-49a7-82f5-c2ea39619eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f5900f-cb8a-485d-866b-580b188cc09c", "name": "network-vif-plugged", "status": "completed", "tag": "374d080b-906f-4857-97aa-846916239632"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:32:51.292431 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-20e834ec-df2e-46eb-b786-c4cfd85f1595 req-afe58f8f-ca65-49a7-82f5-c2ea39619eb3 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:51.293083 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-20e834ec-df2e-46eb-b786-c4cfd85f1595 req-afe58f8f-ca65-49a7-82f5-c2ea39619eb3 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:51.304560 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-20e834ec-df2e-46eb-b786-c4cfd85f1595 req-afe58f8f-ca65-49a7-82f5-c2ea39619eb3 service nova] Creating event network-vif-plugged:374d080b-906f-4857-97aa-846916239632 for instance 96f5900f-cb8a-485d-866b-580b188cc09c on hv-cinder-83800 May 09 04:32:51.310759 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-20e834ec-df2e-46eb-b786-c4cfd85f1595 req-afe58f8f-ca65-49a7-82f5-c2ea39619eb3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031631 May 09 04:32:51.311393 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 458/933] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:51.979345 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-023e70bc-1564-4562-90ce-07acd18e2f37 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:51.979978 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-023e70bc-1564-4562-90ce-07acd18e2f37 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:51.986315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-023e70bc-1564-4562-90ce-07acd18e2f37 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:51.986766 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-023e70bc-1564-4562-90ce-07acd18e2f37 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:51.987534 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-023e70bc-1564-4562-90ce-07acd18e2f37 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:51.988005 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-023e70bc-1564-4562-90ce-07acd18e2f37 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:52.115717 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-023e70bc-1564-4562-90ce-07acd18e2f37 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:52.124731 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-023e70bc-1564-4562-90ce-07acd18e2f37 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:52.126307 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-023e70bc-1564-4562-90ce-07acd18e2f37 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:52.127495 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-023e70bc-1564-4562-90ce-07acd18e2f37 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.152632 May 09 04:32:52.128080 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 476/934] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:51 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:53.146630 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8f63573f-e738-4463-98f5-0d97e8c0ea76 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:53.147258 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8f63573f-e738-4463-98f5-0d97e8c0ea76 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:53.154134 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8f63573f-e738-4463-98f5-0d97e8c0ea76 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:53.154581 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8f63573f-e738-4463-98f5-0d97e8c0ea76 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:53.155337 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8f63573f-e738-4463-98f5-0d97e8c0ea76 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:53.155768 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8f63573f-e738-4463-98f5-0d97e8c0ea76 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:53.289066 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8f63573f-e738-4463-98f5-0d97e8c0ea76 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:53.297353 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8f63573f-e738-4463-98f5-0d97e8c0ea76 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:53.298829 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8f63573f-e738-4463-98f5-0d97e8c0ea76 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:53.300003 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8f63573f-e738-4463-98f5-0d97e8c0ea76 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1730 microversion: 2.20 time: 0.158159 May 09 04:32:53.300568 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 459/935] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:53 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:54.317926 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8612fb41-3049-45cd-a383-561a99ddf294 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:54.318470 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8612fb41-3049-45cd-a383-561a99ddf294 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:54.325056 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8612fb41-3049-45cd-a383-561a99ddf294 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:54.325539 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8612fb41-3049-45cd-a383-561a99ddf294 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:54.326296 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8612fb41-3049-45cd-a383-561a99ddf294 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:54.326730 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8612fb41-3049-45cd-a383-561a99ddf294 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:54.459629 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8612fb41-3049-45cd-a383-561a99ddf294 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:54.468407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8612fb41-3049-45cd-a383-561a99ddf294 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:54.469940 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8612fb41-3049-45cd-a383-561a99ddf294 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:32:54.471110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8612fb41-3049-45cd-a383-561a99ddf294 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1717 microversion: 2.20 time: 0.157318 May 09 04:32:54.471704 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 477/936] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:32:54 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:32:57.237736 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7667e3df-7537-4dea-8ae3-86d67425443c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:57.238662 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7667e3df-7537-4dea-8ae3-86d67425443c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:57.245110 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7667e3df-7537-4dea-8ae3-86d67425443c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:57.245566 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7667e3df-7537-4dea-8ae3-86d67425443c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:57.246339 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7667e3df-7537-4dea-8ae3-86d67425443c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:57.246777 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7667e3df-7537-4dea-8ae3-86d67425443c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:57.276943 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7667e3df-7537-4dea-8ae3-86d67425443c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043062 May 09 04:32:57.277513 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 460/937] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:32:57 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:57.438174 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1a37cb3c-4827-4a62-ade9-351b8c6678f9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:57.438649 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1a37cb3c-4827-4a62-ade9-351b8c6678f9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:57.445056 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a37cb3c-4827-4a62-ade9-351b8c6678f9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:57.445509 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a37cb3c-4827-4a62-ade9-351b8c6678f9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:57.446281 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a37cb3c-4827-4a62-ade9-351b8c6678f9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:57.446722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a37cb3c-4827-4a62-ade9-351b8c6678f9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:57.476836 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1a37cb3c-4827-4a62-ade9-351b8c6678f9 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments/f1ada3cb-a5ad-4a9d-b78e-fc4908a0ca60" status: 200 len: 194 microversion: 2.1 time: 0.042628 May 09 04:32:57.477429 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 478/938] 10.222.0.44 () {58 vars in 1412 bytes} [Mon May 9 04:32:57 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments/f1ada3cb-a5ad-4a9d-b78e-fc4908a0ca60 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:57.487256 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b47f3b67-83cc-4af2-b973-05b976f1ac67 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:57.487740 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b47f3b67-83cc-4af2-b973-05b976f1ac67 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:57.493609 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b47f3b67-83cc-4af2-b973-05b976f1ac67 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:57.494117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b47f3b67-83cc-4af2-b973-05b976f1ac67 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:57.495047 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b47f3b67-83cc-4af2-b973-05b976f1ac67 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:57.495477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b47f3b67-83cc-4af2-b973-05b976f1ac67 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:57.574884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-b47f3b67-83cc-4af2-b973-05b976f1ac67 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lazy-loading 'services' on Instance uuid 576d0314-ed60-4d48-83ec-86645233803c {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:32:57.643035 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b47f3b67-83cc-4af2-b973-05b976f1ac67 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "DELETE /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments/f1ada3cb-a5ad-4a9d-b78e-fc4908a0ca60" status: 202 len: 0 microversion: 2.1 time: 0.159508 May 09 04:32:57.643664 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 461/939] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 04:32:57 2022] DELETE /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments/f1ada3cb-a5ad-4a9d-b78e-fc4908a0ca60 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:32:59.810517 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d418a48b-6bc1-4586-a63c-85908c544ec4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:59.811008 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d418a48b-6bc1-4586-a63c-85908c544ec4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:59.817420 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d418a48b-6bc1-4586-a63c-85908c544ec4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:59.817886 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d418a48b-6bc1-4586-a63c-85908c544ec4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:59.818657 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d418a48b-6bc1-4586-a63c-85908c544ec4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:59.819095 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d418a48b-6bc1-4586-a63c-85908c544ec4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:59.849334 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d418a48b-6bc1-4586-a63c-85908c544ec4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments/9356e137-c778-4191-b72c-f3d483f9b3dd" status: 200 len: 194 microversion: 2.1 time: 0.043455 May 09 04:32:59.849914 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 479/940] 10.222.0.44 () {58 vars in 1412 bytes} [Mon May 9 04:32:59 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments/9356e137-c778-4191-b72c-f3d483f9b3dd => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:32:59.860030 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3f883245-ad39-45c7-bf67-f27b92595db4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:32:59.860601 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3f883245-ad39-45c7-bf67-f27b92595db4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:32:59.867021 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f883245-ad39-45c7-bf67-f27b92595db4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:59.867463 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f883245-ad39-45c7-bf67-f27b92595db4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:59.868237 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f883245-ad39-45c7-bf67-f27b92595db4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:32:59.868664 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f883245-ad39-45c7-bf67-f27b92595db4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:32:59.948075 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-3f883245-ad39-45c7-bf67-f27b92595db4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lazy-loading 'services' on Instance uuid 576d0314-ed60-4d48-83ec-86645233803c {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:33:00.015538 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3f883245-ad39-45c7-bf67-f27b92595db4 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "DELETE /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments/9356e137-c778-4191-b72c-f3d483f9b3dd" status: 202 len: 0 microversion: 2.1 time: 0.159467 May 09 04:33:00.016097 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 462/941] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 04:32:59 2022] DELETE /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments/9356e137-c778-4191-b72c-f3d483f9b3dd => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:33:01.169013 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-42d5e47c-311c-4ccc-b1cb-95b240edacd2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:01.170100 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-42d5e47c-311c-4ccc-b1cb-95b240edacd2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:01.176594 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-42d5e47c-311c-4ccc-b1cb-95b240edacd2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:01.177044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-42d5e47c-311c-4ccc-b1cb-95b240edacd2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:01.177815 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-42d5e47c-311c-4ccc-b1cb-95b240edacd2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:01.178255 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-42d5e47c-311c-4ccc-b1cb-95b240edacd2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:01.207158 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-42d5e47c-311c-4ccc-b1cb-95b240edacd2 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042495 May 09 04:33:01.207711 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 480/942] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:33:01 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 04:33:01.316286 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0ea3db86-d0d8-43b9-bc6d-21f9fd8f6581 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:01.317356 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0ea3db86-d0d8-43b9-bc6d-21f9fd8f6581 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:01.324979 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ea3db86-d0d8-43b9-bc6d-21f9fd8f6581 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:01.325430 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ea3db86-d0d8-43b9-bc6d-21f9fd8f6581 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:01.326232 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ea3db86-d0d8-43b9-bc6d-21f9fd8f6581 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:01.326664 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ea3db86-d0d8-43b9-bc6d-21f9fd8f6581 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:01.356847 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0ea3db86-d0d8-43b9-bc6d-21f9fd8f6581 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044788 May 09 04:33:01.357411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 463/943] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:33:01 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 04:33:01.414003 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-47b0b2b9-9554-4261-8966-5f718648d1f6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:01.414500 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-47b0b2b9-9554-4261-8966-5f718648d1f6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:01.420371 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-47b0b2b9-9554-4261-8966-5f718648d1f6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:01.420818 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-47b0b2b9-9554-4261-8966-5f718648d1f6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:01.421580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-47b0b2b9-9554-4261-8966-5f718648d1f6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:01.422015 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-47b0b2b9-9554-4261-8966-5f718648d1f6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:01.446686 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-47b0b2b9-9554-4261-8966-5f718648d1f6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Going to try to terminate instance {{(pid=117033) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:33:01.531481 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-47b0b2b9-9554-4261-8966-5f718648d1f6 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "DELETE /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 204 len: 0 microversion: 2.1 time: 0.120809 May 09 04:33:01.532890 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 481/944] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:33:01 2022] DELETE /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:33:01.541430 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-16ba3dde-4dee-4aa8-8790-d5f4f31963cc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:01.542170 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-16ba3dde-4dee-4aa8-8790-d5f4f31963cc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:01.565111 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-16ba3dde-4dee-4aa8-8790-d5f4f31963cc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:01.565111 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-16ba3dde-4dee-4aa8-8790-d5f4f31963cc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:01.565111 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-16ba3dde-4dee-4aa8-8790-d5f4f31963cc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:01.565111 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-16ba3dde-4dee-4aa8-8790-d5f4f31963cc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:01.691288 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-16ba3dde-4dee-4aa8-8790-d5f4f31963cc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:01.699712 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-16ba3dde-4dee-4aa8-8790-d5f4f31963cc tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1672 microversion: 2.1 time: 0.162653 May 09 04:33:01.700299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 464/945] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:01 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:02.717828 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b3c23e7e-7737-4599-b2b9-cea961226e7e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:02.718571 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b3c23e7e-7737-4599-b2b9-cea961226e7e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:02.724859 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b3c23e7e-7737-4599-b2b9-cea961226e7e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:02.725304 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b3c23e7e-7737-4599-b2b9-cea961226e7e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:02.726062 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b3c23e7e-7737-4599-b2b9-cea961226e7e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:02.726492 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b3c23e7e-7737-4599-b2b9-cea961226e7e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:02.857734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b3c23e7e-7737-4599-b2b9-cea961226e7e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:02.865650 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b3c23e7e-7737-4599-b2b9-cea961226e7e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1672 microversion: 2.1 time: 0.152557 May 09 04:33:02.866223 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 482/946] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:02 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:03.883795 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-05c5d4a1-32ba-44ad-a510-0afce81c922e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:03.884449 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-05c5d4a1-32ba-44ad-a510-0afce81c922e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:03.890934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-05c5d4a1-32ba-44ad-a510-0afce81c922e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:03.891383 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-05c5d4a1-32ba-44ad-a510-0afce81c922e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:03.892181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-05c5d4a1-32ba-44ad-a510-0afce81c922e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:03.892618 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-05c5d4a1-32ba-44ad-a510-0afce81c922e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:04.020044 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-05c5d4a1-32ba-44ad-a510-0afce81c922e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:04.028069 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-05c5d4a1-32ba-44ad-a510-0afce81c922e tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1672 microversion: 2.1 time: 0.148072 May 09 04:33:04.028638 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 465/947] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:03 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:05.045497 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-e3d5a59f-269a-44e5-b58f-5b3c6cb150f1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:05.046132 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-e3d5a59f-269a-44e5-b58f-5b3c6cb150f1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:05.052454 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e3d5a59f-269a-44e5-b58f-5b3c6cb150f1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:05.052901 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e3d5a59f-269a-44e5-b58f-5b3c6cb150f1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:05.053662 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e3d5a59f-269a-44e5-b58f-5b3c6cb150f1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:05.054094 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-e3d5a59f-269a-44e5-b58f-5b3c6cb150f1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:05.185905 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-e3d5a59f-269a-44e5-b58f-5b3c6cb150f1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:05.193384 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-e3d5a59f-269a-44e5-b58f-5b3c6cb150f1 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1672 microversion: 2.1 time: 0.152166 May 09 04:33:05.194159 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 483/948] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:05 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:06.210296 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-18c8bcc1-1cd0-4135-8a29-3f8d2508871c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:06.211022 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-18c8bcc1-1cd0-4135-8a29-3f8d2508871c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:06.218705 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18c8bcc1-1cd0-4135-8a29-3f8d2508871c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:06.218915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18c8bcc1-1cd0-4135-8a29-3f8d2508871c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:06.219933 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18c8bcc1-1cd0-4135-8a29-3f8d2508871c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:06.220381 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18c8bcc1-1cd0-4135-8a29-3f8d2508871c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:06.298180 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-18c8bcc1-1cd0-4135-8a29-3f8d2508871c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85429c28c994443eb30b98ece56c4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c23c235fa1c4944bd7a337357d0c030', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:06.310684 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-18c8bcc1-1cd0-4135-8a29-3f8d2508871c tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 200 len: 1606 microversion: 2.1 time: 0.104157 May 09 04:33:06.311491 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 466/949] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:06 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 1606 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:06.374679 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-6082dd93-3bbe-4ff7-a313-5b97c66ebb9d req-f9223202-8ca0-45a5-85f1-9c8caa2e3053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "576d0314-ed60-4d48-83ec-86645233803c", "name": "network-vif-deleted", "tag": "e30725aa-831c-4789-9157-939a4a0d3bea"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:06.388169 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-6082dd93-3bbe-4ff7-a313-5b97c66ebb9d req-f9223202-8ca0-45a5-85f1-9c8caa2e3053 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:06.388631 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-6082dd93-3bbe-4ff7-a313-5b97c66ebb9d req-f9223202-8ca0-45a5-85f1-9c8caa2e3053 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:06.407254 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-6082dd93-3bbe-4ff7-a313-5b97c66ebb9d req-f9223202-8ca0-45a5-85f1-9c8caa2e3053 service nova] Creating event network-vif-deleted:e30725aa-831c-4789-9157-939a4a0d3bea for instance 576d0314-ed60-4d48-83ec-86645233803c on hv-cinder-83800 May 09 04:33:06.413808 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-6082dd93-3bbe-4ff7-a313-5b97c66ebb9d req-f9223202-8ca0-45a5-85f1-9c8caa2e3053 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045421 May 09 04:33:06.418726 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 484/950] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:33:07.328965 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7ab2f900-0c48-4abb-a26b-f0308efa2a99 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:07.329604 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7ab2f900-0c48-4abb-a26b-f0308efa2a99 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:07.336071 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7ab2f900-0c48-4abb-a26b-f0308efa2a99 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:07.336599 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7ab2f900-0c48-4abb-a26b-f0308efa2a99 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:07.337373 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7ab2f900-0c48-4abb-a26b-f0308efa2a99 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:07.337803 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7ab2f900-0c48-4abb-a26b-f0308efa2a99 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:07.353056 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-7ab2f900-0c48-4abb-a26b-f0308efa2a99 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] HTTP exception thrown: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7ab2f900-0c48-4abb-a26b-f0308efa2a99 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Request method failure captured: May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c HTTP/1.1 May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJfsOwB-_DgX5ZO9256k2I3UlwLV6InbIE55-tlgUJ6EclsTlhsb31ecA6VrELMtC8lDMItruSO-h_e4ze-GkoQBurc-EMbECIHJY1WryYqZrA50jzy7ATDaUxxjq0BMjfbmk6FJOkPQ74YWNhSnmz1MTCXT6bVM3CUwAkfffWtcwYM May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 3c23c235fa1c4944bd7a337357d0c030 May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:33:07.354934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:33:07.356548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:07.356548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:07.356548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 3c23c235fa1c4944bd7a337357d0c030 May 09 04:33:07.356548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:07.356548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-AttachVolumeTestJSON-1840327184-project May 09 04:33:07.356548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:33:07.356548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:33:07.356548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 85429c28c994443eb30b98ece56c4c9b May 09 04:33:07.356548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-AttachVolumeTestJSON-1840327184-project May 09 04:33:07.356548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:33:07.356548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:07.356548 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '576d0314-ed60-4d48-83ec-86645233803c'} May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:07.360681 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:07.362109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:07.363430 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7ab2f900-0c48-4abb-a26b-f0308efa2a99 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Returning 404 to user: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:07.363430 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7ab2f900-0c48-4abb-a26b-f0308efa2a99 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 404 len: 111 microversion: 2.1 time: 0.031377 May 09 04:33:07.363430 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 467/951] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:07 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 04:33:07.366099 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-52906086-6be7-46ab-a684-b347dc395de0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '.version_select at 0x7fbfd97c0ee0>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:07.384125 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-52906086-6be7-46ab-a684-b347dc395de0 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-823453614" status: 202 len: 0 microversion: 2.1 time: 0.022345 May 09 04:33:07.384855 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 485/952] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 9 04:33:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-823453614 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:33:12.331538 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-17863adf-37ea-4090-96e5-36e77589f7b5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:12.332072 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-17863adf-37ea-4090-96e5-36e77589f7b5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:12.338434 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17863adf-37ea-4090-96e5-36e77589f7b5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:12.339134 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17863adf-37ea-4090-96e5-36e77589f7b5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:12.339913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17863adf-37ea-4090-96e5-36e77589f7b5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:12.340364 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17863adf-37ea-4090-96e5-36e77589f7b5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:12.354022 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-17863adf-37ea-4090-96e5-36e77589f7b5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] HTTP exception thrown: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-17863adf-37ea-4090-96e5-36e77589f7b5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Request method failure captured: May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: DELETE /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c HTTP/1.1 May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJfsOwB-_DgX5ZO9256k2I3UlwLV6InbIE55-tlgUJ6EclsTlhsb31ecA6VrELMtC8lDMItruSO-h_e4ze-GkoQBurc-EMbECIHJY1WryYqZrA50jzy7ATDaUxxjq0BMjfbmk6FJOkPQ74YWNhSnmz1MTCXT6bVM3CUwAkfffWtcwYM May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 3c23c235fa1c4944bd7a337357d0c030 May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:33:12.355556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:33:12.357576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:12.357576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:12.357576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 3c23c235fa1c4944bd7a337357d0c030 May 09 04:33:12.357576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:12.357576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-AttachVolumeTestJSON-1840327184-project May 09 04:33:12.357576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:33:12.357576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:33:12.357576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 85429c28c994443eb30b98ece56c4c9b May 09 04:33:12.357576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-AttachVolumeTestJSON-1840327184-project May 09 04:33:12.357576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:33:12.357576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:12.357576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '576d0314-ed60-4d48-83ec-86645233803c'} May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:12.358289 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:12.359626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:12.361055 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-17863adf-37ea-4090-96e5-36e77589f7b5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Returning 404 to user: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:12.361055 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-17863adf-37ea-4090-96e5-36e77589f7b5 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "DELETE /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 404 len: 111 microversion: 2.1 time: 0.029361 May 09 04:33:12.361055 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 468/953] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:33:12 2022] DELETE /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:33:12.366735 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-bcebdb61-bab9-4aea-9e2a-7c576366a790 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:12.367471 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-bcebdb61-bab9-4aea-9e2a-7c576366a790 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: 576d0314-ed60-4d48-83ec-86645233803c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:12.374212 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bcebdb61-bab9-4aea-9e2a-7c576366a790 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:12.374662 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bcebdb61-bab9-4aea-9e2a-7c576366a790 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:12.375427 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bcebdb61-bab9-4aea-9e2a-7c576366a790 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:12.375867 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bcebdb61-bab9-4aea-9e2a-7c576366a790 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:12.389075 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-bcebdb61-bab9-4aea-9e2a-7c576366a790 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] HTTP exception thrown: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-bcebdb61-bab9-4aea-9e2a-7c576366a790 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Request method failure captured: May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c HTTP/1.1 May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJfsOwB-_DgX5ZO9256k2I3UlwLV6InbIE55-tlgUJ6EclsTlhsb31ecA6VrELMtC8lDMItruSO-h_e4ze-GkoQBurc-EMbECIHJY1WryYqZrA50jzy7ATDaUxxjq0BMjfbmk6FJOkPQ74YWNhSnmz1MTCXT6bVM3CUwAkfffWtcwYM May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 3c23c235fa1c4944bd7a337357d0c030 May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:33:12.390670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:33:12.392236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:12.392236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:12.392236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 3c23c235fa1c4944bd7a337357d0c030 May 09 04:33:12.392236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:12.392236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-AttachVolumeTestJSON-1840327184-project May 09 04:33:12.392236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:33:12.392236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:33:12.392236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 85429c28c994443eb30b98ece56c4c9b May 09 04:33:12.392236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-AttachVolumeTestJSON-1840327184-project May 09 04:33:12.392236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:33:12.392236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:12.392236 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': '576d0314-ed60-4d48-83ec-86645233803c'} May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:12.393103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. May 09 04:33:12.394474 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:12.395834 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-bcebdb61-bab9-4aea-9e2a-7c576366a790 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Returning 404 to user: Instance 576d0314-ed60-4d48-83ec-86645233803c could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:12.395834 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-bcebdb61-bab9-4aea-9e2a-7c576366a790 tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c" status: 404 len: 111 microversion: 2.1 time: 0.029626 May 09 04:33:12.395834 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 486/954] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:12 2022] GET /compute/v2.1/servers/576d0314-ed60-4d48-83ec-86645233803c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:33:13.529571 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4db4a370-febf-4ddc-9b60-39b2bd243f3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:13.530193 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4db4a370-febf-4ddc-9b60-39b2bd243f3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:13.536644 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4db4a370-febf-4ddc-9b60-39b2bd243f3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:13.537090 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4db4a370-febf-4ddc-9b60-39b2bd243f3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:13.537867 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4db4a370-febf-4ddc-9b60-39b2bd243f3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:13.538309 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4db4a370-febf-4ddc-9b60-39b2bd243f3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:13.551618 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-4db4a370-febf-4ddc-9b60-39b2bd243f3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] HTTP exception thrown: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4db4a370-febf-4ddc-9b60-39b2bd243f3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Request method failure captured: May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: DELETE /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 HTTP/1.1 May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJfsOwB-_DgX5ZO9256k2I3UlwLV6InbIE55-tlgUJ6EclsTlhsb31ecA6VrELMtC8lDMItruSO-h_e4ze-GkoQBurc-EMbECIHJY1WryYqZrA50jzy7ATDaUxxjq0BMjfbmk6FJOkPQ74YWNhSnmz1MTCXT6bVM3CUwAkfffWtcwYM May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 3c23c235fa1c4944bd7a337357d0c030 May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:33:13.553321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:33:13.554825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:13.554825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:13.554825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 3c23c235fa1c4944bd7a337357d0c030 May 09 04:33:13.554825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:13.554825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-AttachVolumeTestJSON-1840327184-project May 09 04:33:13.554825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:33:13.554825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:33:13.554825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 85429c28c994443eb30b98ece56c4c9b May 09 04:33:13.554825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-AttachVolumeTestJSON-1840327184-project May 09 04:33:13.554825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:33:13.554825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:33:13.554825 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': 'f2923fc2-3ae0-4f89-b36c-193752581504'} May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:13.555660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:33:13.556987 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:13.558125 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4db4a370-febf-4ddc-9b60-39b2bd243f3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Returning 404 to user: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:13.558125 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4db4a370-febf-4ddc-9b60-39b2bd243f3f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 404 len: 111 microversion: 2.1 time: 0.029074 May 09 04:33:13.558125 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 469/955] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:33:13 2022] DELETE /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:33:13.563814 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b5eb16ec-2848-4875-94c4-884066a7d60f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:13.564459 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b5eb16ec-2848-4875-94c4-884066a7d60f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] [instance: f2923fc2-3ae0-4f89-b36c-193752581504] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:13.570839 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b5eb16ec-2848-4875-94c4-884066a7d60f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:13.571283 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b5eb16ec-2848-4875-94c4-884066a7d60f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:13.572113 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b5eb16ec-2848-4875-94c4-884066a7d60f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:13.572549 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b5eb16ec-2848-4875-94c4-884066a7d60f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:13.586524 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-b5eb16ec-2848-4875-94c4-884066a7d60f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] HTTP exception thrown: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b5eb16ec-2848-4875-94c4-884066a7d60f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Request method failure captured: May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 HTTP/1.1 May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJfsOwB-_DgX5ZO9256k2I3UlwLV6InbIE55-tlgUJ6EclsTlhsb31ecA6VrELMtC8lDMItruSO-h_e4ze-GkoQBurc-EMbECIHJY1WryYqZrA50jzy7ATDaUxxjq0BMjfbmk6FJOkPQ74YWNhSnmz1MTCXT6bVM3CUwAkfffWtcwYM May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 3c23c235fa1c4944bd7a337357d0c030 May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:33:13.588110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:33:13.589872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3c23c235fa1c4944bd7a337357d0c030"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:13.589872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:13.589872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 3c23c235fa1c4944bd7a337357d0c030 May 09 04:33:13.589872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1840327184 May 09 04:33:13.589872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-AttachVolumeTestJSON-1840327184-project May 09 04:33:13.589872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:33:13.589872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:33:13.589872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 85429c28c994443eb30b98ece56c4c9b May 09 04:33:13.589872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-AttachVolumeTestJSON-1840327184-project May 09 04:33:13.589872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:33:13.589872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:33:13.589872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': 'f2923fc2-3ae0-4f89-b36c-193752581504'} May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:13.590722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. May 09 04:33:13.592123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:13.593378 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b5eb16ec-2848-4875-94c4-884066a7d60f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] Returning 404 to user: Instance f2923fc2-3ae0-4f89-b36c-193752581504 could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:13.593378 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b5eb16ec-2848-4875-94c4-884066a7d60f tempest-AttachVolumeTestJSON-1840327184 tempest-AttachVolumeTestJSON-1840327184-project] 10.222.0.44 "GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504" status: 404 len: 111 microversion: 2.1 time: 0.030243 May 09 04:33:13.593378 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 487/956] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:13 2022] GET /compute/v2.1/servers/f2923fc2-3ae0-4f89-b36c-193752581504 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:33:17.931587 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6e1b72ab-11f3-457f-85c1-30766efc2546 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Action: 'create', calling method: .version_select at 0x7fbfd44bf3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1658204820", "metadata": {"Type": "work"}}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6e1b72ab-11f3-457f-85c1-30766efc2546 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Request method failure captured: May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 122 May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJmNC-VUu4E8Mcbqvt5KMt47e9ZQfcVN1a9_uJBD4VgJd1HvbHRrBqM3LD7bnseBo9chhOkGcrSqt2yhbkAImCLD6UUbjmXBBBs9DR3Zb2siRtBYEfLxVNP_ehLxdebp-VJjZmrsN2_AQTcGeNQXoPXCy1ZV9JXPwBHPn5faPH49JLo May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 853d056feee44f418d44536348bcfe2b May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-VolumesNegativeTest-1952217118 May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:33:17.946209 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:33:17.947573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/853d056feee44f418d44536348bcfe2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/853d056feee44f418d44536348bcfe2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/853d056feee44f418d44536348bcfe2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_853d056feee44f418d44536348bcfe2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:17.947573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-VolumesNegativeTest-1952217118 May 09 04:33:17.947573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 853d056feee44f418d44536348bcfe2b May 09 04:33:17.947573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-VolumesNegativeTest-1952217118 May 09 04:33:17.947573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-VolumesNegativeTest-1952217118-project May 09 04:33:17.947573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:33:17.947573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:33:17.947573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 39ae2218b9c64d239fc8487be1708b92 May 09 04:33:17.947573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-VolumesNegativeTest-1952217118-project May 09 04:33:17.947573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: May 09 04:33:17.947573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1658204820", "metadata": {"Type": "work"}}} May 09 04:33:17.947573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: May 09 04:33:17.947573 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1658204820', 'metadata': {'Type': 'work'}}}} May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise error May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi '#$%' May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:17.948495 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 04:33:17.949765 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 04:33:17.950912 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 04:33:17.950912 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:17.950912 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6e1b72ab-11f3-457f-85c1-30766efc2546 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:17.950912 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6e1b72ab-11f3-457f-85c1-30766efc2546 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.207627 May 09 04:33:17.950912 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 470/957] 10.222.0.44 () {60 vars in 1155 bytes} [Mon May 9 04:33:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 09 04:33:17.958289 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f227735e-c63f-4b4b-8975-b20d010f05c6 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Action: 'create', calling method: .version_select at 0x7fbfd9706040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1330568651", "metadata": {"Type": "work"}}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f227735e-c63f-4b4b-8975-b20d010f05c6 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Request method failure captured: May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 120 May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJmNC-VUu4E8Mcbqvt5KMt47e9ZQfcVN1a9_uJBD4VgJd1HvbHRrBqM3LD7bnseBo9chhOkGcrSqt2yhbkAImCLD6UUbjmXBBBs9DR3Zb2siRtBYEfLxVNP_ehLxdebp-VJjZmrsN2_AQTcGeNQXoPXCy1ZV9JXPwBHPn5faPH49JLo May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 853d056feee44f418d44536348bcfe2b May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-VolumesNegativeTest-1952217118 May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:33:17.961661 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:33:17.963226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/853d056feee44f418d44536348bcfe2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/853d056feee44f418d44536348bcfe2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/853d056feee44f418d44536348bcfe2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_853d056feee44f418d44536348bcfe2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:17.963226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-VolumesNegativeTest-1952217118 May 09 04:33:17.963226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 853d056feee44f418d44536348bcfe2b May 09 04:33:17.963226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-VolumesNegativeTest-1952217118 May 09 04:33:17.963226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-VolumesNegativeTest-1952217118-project May 09 04:33:17.963226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:33:17.963226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:33:17.963226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 39ae2218b9c64d239fc8487be1708b92 May 09 04:33:17.963226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-VolumesNegativeTest-1952217118-project May 09 04:33:17.963226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: May 09 04:33:17.963226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1330568651", "metadata": {"Type": "work"}}} May 09 04:33:17.963226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: May 09 04:33:17.963226 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1330568651', 'metadata': {'Type': 'work'}}}} May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise error May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi '0' May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:17.964467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 04:33:17.966029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 04:33:17.968785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 04:33:17.968785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:17.968785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f227735e-c63f-4b4b-8975-b20d010f05c6 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:17.968785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f227735e-c63f-4b4b-8975-b20d010f05c6 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010366 May 09 04:33:17.968785 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 488/958] 10.222.0.44 () {60 vars in 1155 bytes} [Mon May 9 04:33:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 04:33:17.975888 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-eb43e775-4b39-4986-a70d-e51f46a87c82 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Action: 'create', calling method: .version_select at 0x7fbfd44bd3a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2121044379", "metadata": {"Type": "work"}}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-eb43e775-4b39-4986-a70d-e51f46a87c82 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Request method failure captured: May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 119 May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJmNC-VUu4E8Mcbqvt5KMt47e9ZQfcVN1a9_uJBD4VgJd1HvbHRrBqM3LD7bnseBo9chhOkGcrSqt2yhbkAImCLD6UUbjmXBBBs9DR3Zb2siRtBYEfLxVNP_ehLxdebp-VJjZmrsN2_AQTcGeNQXoPXCy1ZV9JXPwBHPn5faPH49JLo May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 853d056feee44f418d44536348bcfe2b May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-VolumesNegativeTest-1952217118 May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:33:17.979210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:33:17.980820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/853d056feee44f418d44536348bcfe2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/853d056feee44f418d44536348bcfe2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/853d056feee44f418d44536348bcfe2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_853d056feee44f418d44536348bcfe2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:17.980820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-VolumesNegativeTest-1952217118 May 09 04:33:17.980820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 853d056feee44f418d44536348bcfe2b May 09 04:33:17.980820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-VolumesNegativeTest-1952217118 May 09 04:33:17.980820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-VolumesNegativeTest-1952217118-project May 09 04:33:17.980820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:33:17.980820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:33:17.980820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 39ae2218b9c64d239fc8487be1708b92 May 09 04:33:17.980820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-VolumesNegativeTest-1952217118-project May 09 04:33:17.980820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: May 09 04:33:17.980820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2121044379", "metadata": {"Type": "work"}}} May 09 04:33:17.980820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: May 09 04:33:17.980820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2121044379', 'metadata': {'Type': 'work'}}}} May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise error May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi '' May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:17.981778 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 04:33:17.983515 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 04:33:17.984777 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 04:33:17.984777 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:17.984777 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-eb43e775-4b39-4986-a70d-e51f46a87c82 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:17.984777 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-eb43e775-4b39-4986-a70d-e51f46a87c82 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008571 May 09 04:33:17.984777 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 471/959] 10.222.0.44 () {60 vars in 1155 bytes} [Mon May 9 04:33:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 04:33:17.991916 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f20d9274-bcbc-428b-b335-2b885a5f742d tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Calling method '.version_select at 0x7fbfd45cf160>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:18.021364 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-f20d9274-bcbc-428b-b335-2b885a5f742d tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] HTTP exception thrown: Volume tempest-invalid-1196378618 could not be found. May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f20d9274-bcbc-428b-b335-2b885a5f742d tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Request method failure captured: May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1196378618 HTTP/1.1 May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJmNC-VUu4E8Mcbqvt5KMt47e9ZQfcVN1a9_uJBD4VgJd1HvbHRrBqM3LD7bnseBo9chhOkGcrSqt2yhbkAImCLD6UUbjmXBBBs9DR3Zb2siRtBYEfLxVNP_ehLxdebp-VJjZmrsN2_AQTcGeNQXoPXCy1ZV9JXPwBHPn5faPH49JLo May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 853d056feee44f418d44536348bcfe2b May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-VolumesNegativeTest-1952217118 May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:33:18.023337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:33:18.024860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/853d056feee44f418d44536348bcfe2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/853d056feee44f418d44536348bcfe2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/853d056feee44f418d44536348bcfe2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_853d056feee44f418d44536348bcfe2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:18.024860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-VolumesNegativeTest-1952217118 May 09 04:33:18.024860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 853d056feee44f418d44536348bcfe2b May 09 04:33:18.024860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-VolumesNegativeTest-1952217118 May 09 04:33:18.024860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-VolumesNegativeTest-1952217118-project May 09 04:33:18.024860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:33:18.024860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:33:18.024860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 39ae2218b9c64d239fc8487be1708b92 May 09 04:33:18.024860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-VolumesNegativeTest-1952217118-project May 09 04:33:18.024860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: May 09 04:33:18.024860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Volume tempest-invalid-1196378618 could not be found. May 09 04:33:18.024860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': 'tempest-invalid-1196378618'} May 09 04:33:18.024860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1196378618 could not be found. (HTTP 404) (Request-ID: req-cb5f5cbe-55d2-4d3b-8b4f-6c7991a9b20c) May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:18.025755 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 04:33:18.027090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1196378618 could not be found. May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:18.028721 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1196378618 could not be found. May 09 04:33:18.030261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:18.030261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:18.030261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:18.030261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:18.030261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:18.030261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:18.030261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:18.030261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:18.030261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1196378618 could not be found. May 09 04:33:18.030261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:18.030261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f20d9274-bcbc-428b-b335-2b885a5f742d tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Returning 404 to user: Volume tempest-invalid-1196378618 could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:18.030261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f20d9274-bcbc-428b-b335-2b885a5f742d tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1196378618" status: 404 len: 99 microversion: 2.1 time: 0.037396 May 09 04:33:18.030261 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 489/960] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 9 04:33:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1196378618 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 09 04:33:18.034564 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-304201d0-d6a7-4e20-bf40-1d35f6be42b1 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003778 May 09 04:33:18.035078 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 472/961] 10.222.0.44 () {58 vars in 1139 bytes} [Mon May 9 04:33:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 09 04:33:18.044228 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-fb61ecb0-9e1d-45e2-954e-a68a0695de6d tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004110 May 09 04:33:18.044726 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 490/962] 10.222.0.44 () {58 vars in 1136 bytes} [Mon May 9 04:33:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 09 04:33:18.053567 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c71477a6-bfa7-44fd-8bc8-7a4a422ebdd3 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Calling method '.version_select at 0x7fbfd44bfca0>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:18.081922 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-c71477a6-bfa7-44fd-8bc8-7a4a422ebdd3 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] HTTP exception thrown: Volume 29daa5f5-7213-4eab-90f0-906c05484517 could not be found. May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c71477a6-bfa7-44fd-8bc8-7a4a422ebdd3 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Request method failure captured: May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: DELETE /compute/v2.1/os-volumes/29daa5f5-7213-4eab-90f0-906c05484517 HTTP/1.1 May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJmNC-VUu4E8Mcbqvt5KMt47e9ZQfcVN1a9_uJBD4VgJd1HvbHRrBqM3LD7bnseBo9chhOkGcrSqt2yhbkAImCLD6UUbjmXBBBs9DR3Zb2siRtBYEfLxVNP_ehLxdebp-VJjZmrsN2_AQTcGeNQXoPXCy1ZV9JXPwBHPn5faPH49JLo May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 853d056feee44f418d44536348bcfe2b May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-VolumesNegativeTest-1952217118 May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:33:18.084086 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:33:18.085854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/853d056feee44f418d44536348bcfe2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/853d056feee44f418d44536348bcfe2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/853d056feee44f418d44536348bcfe2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_853d056feee44f418d44536348bcfe2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:18.085854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-VolumesNegativeTest-1952217118 May 09 04:33:18.085854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 853d056feee44f418d44536348bcfe2b May 09 04:33:18.085854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-VolumesNegativeTest-1952217118 May 09 04:33:18.085854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-VolumesNegativeTest-1952217118-project May 09 04:33:18.085854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:33:18.085854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:33:18.085854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 39ae2218b9c64d239fc8487be1708b92 May 09 04:33:18.085854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-VolumesNegativeTest-1952217118-project May 09 04:33:18.085854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: May 09 04:33:18.085854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Volume 29daa5f5-7213-4eab-90f0-906c05484517 could not be found. May 09 04:33:18.085854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '29daa5f5-7213-4eab-90f0-906c05484517'} May 09 04:33:18.085854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 29daa5f5-7213-4eab-90f0-906c05484517 could not be found. (HTTP 404) (Request-ID: req-b4f95df0-9b5c-470c-a7eb-9fefb01df664) May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:18.091509 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 04:33:18.092936 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 29daa5f5-7213-4eab-90f0-906c05484517 could not be found. May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 04:33:18.094284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:18.096343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 29daa5f5-7213-4eab-90f0-906c05484517 could not be found. May 09 04:33:18.096343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:18.096343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:18.096343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:18.096343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:18.096343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:18.096343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:18.096343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:18.096343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:18.096343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 29daa5f5-7213-4eab-90f0-906c05484517 could not be found. May 09 04:33:18.096343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:18.096343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c71477a6-bfa7-44fd-8bc8-7a4a422ebdd3 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Returning 404 to user: Volume 29daa5f5-7213-4eab-90f0-906c05484517 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:18.096343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c71477a6-bfa7-44fd-8bc8-7a4a422ebdd3 tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/29daa5f5-7213-4eab-90f0-906c05484517" status: 404 len: 109 microversion: 2.1 time: 0.035661 May 09 04:33:18.096343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 473/963] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 04:33:18 2022] DELETE /compute/v2.1/os-volumes/29daa5f5-7213-4eab-90f0-906c05484517 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:33:18.102256 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c93de602-bcd4-4266-abf9-4fc0844e8ecb tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Calling method '.version_select at 0x7fbfd9733040>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:18.130175 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-c93de602-bcd4-4266-abf9-4fc0844e8ecb tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] HTTP exception thrown: Volume 33b7e51e-097b-4732-b251-bc439355c199 could not be found. May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c93de602-bcd4-4266-abf9-4fc0844e8ecb tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Request method failure captured: May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/os-volumes/33b7e51e-097b-4732-b251-bc439355c199 HTTP/1.1 May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJmNC-VUu4E8Mcbqvt5KMt47e9ZQfcVN1a9_uJBD4VgJd1HvbHRrBqM3LD7bnseBo9chhOkGcrSqt2yhbkAImCLD6UUbjmXBBBs9DR3Zb2siRtBYEfLxVNP_ehLxdebp-VJjZmrsN2_AQTcGeNQXoPXCy1ZV9JXPwBHPn5faPH49JLo May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 853d056feee44f418d44536348bcfe2b May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-VolumesNegativeTest-1952217118 May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:33:18.132139 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:33:18.133678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/853d056feee44f418d44536348bcfe2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/853d056feee44f418d44536348bcfe2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/853d056feee44f418d44536348bcfe2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_853d056feee44f418d44536348bcfe2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:18.133678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-VolumesNegativeTest-1952217118 May 09 04:33:18.133678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 853d056feee44f418d44536348bcfe2b May 09 04:33:18.133678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-VolumesNegativeTest-1952217118 May 09 04:33:18.133678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-VolumesNegativeTest-1952217118-project May 09 04:33:18.133678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:33:18.133678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:33:18.133678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 39ae2218b9c64d239fc8487be1708b92 May 09 04:33:18.133678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-VolumesNegativeTest-1952217118-project May 09 04:33:18.133678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: May 09 04:33:18.133678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Volume 33b7e51e-097b-4732-b251-bc439355c199 could not be found. May 09 04:33:18.133678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': '33b7e51e-097b-4732-b251-bc439355c199'} May 09 04:33:18.133678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 33b7e51e-097b-4732-b251-bc439355c199 could not be found. (HTTP 404) (Request-ID: req-235fdd93-7518-4298-a602-c16ebf59c7bb) May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:18.134636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 04:33:18.136000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 33b7e51e-097b-4732-b251-bc439355c199 could not be found. May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 04:33:18.137240 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:18.138621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 33b7e51e-097b-4732-b251-bc439355c199 could not be found. May 09 04:33:18.138621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:18.138621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:18.138621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:18.138621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:18.138621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:18.138621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:18.138621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:18.138621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:18.138621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 33b7e51e-097b-4732-b251-bc439355c199 could not be found. May 09 04:33:18.138621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:18.138621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c93de602-bcd4-4266-abf9-4fc0844e8ecb tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] Returning 404 to user: Volume 33b7e51e-097b-4732-b251-bc439355c199 could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:18.138621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c93de602-bcd4-4266-abf9-4fc0844e8ecb tempest-VolumesNegativeTest-1952217118 tempest-VolumesNegativeTest-1952217118-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/33b7e51e-097b-4732-b251-bc439355c199" status: 404 len: 109 microversion: 2.1 time: 0.035101 May 09 04:33:18.138621 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 491/964] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 04:33:18 2022] GET /compute/v2.1/os-volumes/33b7e51e-097b-4732-b251-bc439355c199 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:33:23.139226 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f74ad9d4-6a84-4231-b1a0-3e0b3c08a469 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:23.139847 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f74ad9d4-6a84-4231-b1a0-3e0b3c08a469 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:23.145799 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f74ad9d4-6a84-4231-b1a0-3e0b3c08a469 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:23.146246 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f74ad9d4-6a84-4231-b1a0-3e0b3c08a469 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:23.147021 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f74ad9d4-6a84-4231-b1a0-3e0b3c08a469 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:23.147457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f74ad9d4-6a84-4231-b1a0-3e0b3c08a469 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:23.173821 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f74ad9d4-6a84-4231-b1a0-3e0b3c08a469 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328/ips" status: 200 len: 149 microversion: 2.1 time: 0.226908 May 09 04:33:23.174402 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 474/965] 10.222.0.44 () {58 vars in 1247 bytes} [Mon May 9 04:33:22 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328/ips => generated 149 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:33:24.649418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-df47f060-586b-48d1-8b49-434e03b26d74 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff391078-7e15-426f-bc40-d0e5f3015c7b"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:24.650520 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-df47f060-586b-48d1-8b49-434e03b26d74 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:24.657950 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df47f060-586b-48d1-8b49-434e03b26d74 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:24.659059 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df47f060-586b-48d1-8b49-434e03b26d74 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:24.659829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df47f060-586b-48d1-8b49-434e03b26d74 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:24.660441 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-df47f060-586b-48d1-8b49-434e03b26d74 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:25.066058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-df47f060-586b-48d1-8b49-434e03b26d74 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "POST /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421515 May 09 04:33:25.067116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 492/966] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 04:33:24 2022] POST /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328/os-volume_attachments => generated 194 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:33:25.363754 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d11784c5-1c89-46d4-8835-019e32f206fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:25.364358 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d11784c5-1c89-46d4-8835-019e32f206fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:25.370218 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-2df223ad-b520-4381-8895-102b03bb1c4f req-c26e66f7-43ae-465b-80f5-7955e3542baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a541a008-c541-407b-8868-a2b9d98ed15d", "tag": "8b3c8f68-461e-4b7f-843a-747af41739b1"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:25.371628 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d11784c5-1c89-46d4-8835-019e32f206fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:25.372341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d11784c5-1c89-46d4-8835-019e32f206fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:25.373645 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d11784c5-1c89-46d4-8835-019e32f206fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:25.374640 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d11784c5-1c89-46d4-8835-019e32f206fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:25.389624 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-2df223ad-b520-4381-8895-102b03bb1c4f req-c26e66f7-43ae-465b-80f5-7955e3542baa service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:25.390293 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-2df223ad-b520-4381-8895-102b03bb1c4f req-c26e66f7-43ae-465b-80f5-7955e3542baa service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:25.404842 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d11784c5-1c89-46d4-8835-019e32f206fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:33:25.406671 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-2df223ad-b520-4381-8895-102b03bb1c4f req-c26e66f7-43ae-465b-80f5-7955e3542baa service nova] Creating event network-changed:8b3c8f68-461e-4b7f-843a-747af41739b1 for instance a541a008-c541-407b-8868-a2b9d98ed15d on hv-cinder-83800 May 09 04:33:25.413586 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-2df223ad-b520-4381-8895-102b03bb1c4f req-c26e66f7-43ae-465b-80f5-7955e3542baa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048550 May 09 04:33:25.414385 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 493/967] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:33:25.522049 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d11784c5-1c89-46d4-8835-019e32f206fc tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 204 len: 0 microversion: 2.1 time: 0.162152 May 09 04:33:25.525658 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 475/968] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:33:25 2022] DELETE /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:33:25.532443 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ac9fc66c-b479-47f9-8e95-38f31d07efbf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:25.533152 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ac9fc66c-b479-47f9-8e95-38f31d07efbf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:25.540505 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ac9fc66c-b479-47f9-8e95-38f31d07efbf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:25.540967 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ac9fc66c-b479-47f9-8e95-38f31d07efbf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:25.541758 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ac9fc66c-b479-47f9-8e95-38f31d07efbf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:25.542207 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ac9fc66c-b479-47f9-8e95-38f31d07efbf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:25.714350 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ac9fc66c-b479-47f9-8e95-38f31d07efbf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:25.714350 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ac9fc66c-b479-47f9-8e95-38f31d07efbf tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1568 microversion: 2.1 time: 0.179148 May 09 04:33:25.714350 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 494/969] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:25 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:26.725157 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d0a2866d-d236-44dc-a6c6-8271394392dd tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:26.725843 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d0a2866d-d236-44dc-a6c6-8271394392dd tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:26.732304 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d0a2866d-d236-44dc-a6c6-8271394392dd tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:26.732983 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d0a2866d-d236-44dc-a6c6-8271394392dd tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:26.733912 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d0a2866d-d236-44dc-a6c6-8271394392dd tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:26.734343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d0a2866d-d236-44dc-a6c6-8271394392dd tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:26.930250 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d0a2866d-d236-44dc-a6c6-8271394392dd tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:26.938624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d0a2866d-d236-44dc-a6c6-8271394392dd tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1568 microversion: 2.1 time: 0.217684 May 09 04:33:26.948636 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 476/970] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:26 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:27.629440 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-1ca225bf-4edf-4344-a641-bd70bbb00f94 req-44f10576-3b35-43e1-82cc-c713982ab654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a541a008-c541-407b-8868-a2b9d98ed15d", "name": "network-vif-deleted", "tag": "8b3c8f68-461e-4b7f-843a-747af41739b1"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:27.640603 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-1ca225bf-4edf-4344-a641-bd70bbb00f94 req-44f10576-3b35-43e1-82cc-c713982ab654 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:27.640992 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-1ca225bf-4edf-4344-a641-bd70bbb00f94 req-44f10576-3b35-43e1-82cc-c713982ab654 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:27.653469 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-1ca225bf-4edf-4344-a641-bd70bbb00f94 req-44f10576-3b35-43e1-82cc-c713982ab654 service nova] Creating event network-vif-deleted:8b3c8f68-461e-4b7f-843a-747af41739b1 for instance a541a008-c541-407b-8868-a2b9d98ed15d on hv-cinder-83800 May 09 04:33:27.660644 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-1ca225bf-4edf-4344-a641-bd70bbb00f94 req-44f10576-3b35-43e1-82cc-c713982ab654 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035665 May 09 04:33:27.661235 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 495/971] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:33:27.956147 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-60dec5bb-f0b9-429b-8966-8a2998c412b6 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:27.961100 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-60dec5bb-f0b9-429b-8966-8a2998c412b6 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:27.978112 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-60dec5bb-f0b9-429b-8966-8a2998c412b6 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:27.978795 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-60dec5bb-f0b9-429b-8966-8a2998c412b6 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:27.980161 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-60dec5bb-f0b9-429b-8966-8a2998c412b6 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:27.981296 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-60dec5bb-f0b9-429b-8966-8a2998c412b6 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:28.046759 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-60dec5bb-f0b9-429b-8966-8a2998c412b6 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:28.047210 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-60dec5bb-f0b9-429b-8966-8a2998c412b6 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:28.048013 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-60dec5bb-f0b9-429b-8966-8a2998c412b6 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lazy-loading 'fault' on Instance uuid a541a008-c541-407b-8868-a2b9d98ed15d {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:33:28.106204 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-60dec5bb-f0b9-429b-8966-8a2998c412b6 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc01367aaf7742d8abdd0fdc4de64f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cbe32e8ede404fa3d19537256606e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:28.118188 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-60dec5bb-f0b9-429b-8966-8a2998c412b6 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 200 len: 1223 microversion: 2.1 time: 0.166293 May 09 04:33:28.118951 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 477/972] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:27 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 1223 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:29.136606 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-05efa357-3c85-4479-88c9-d9c3611121a3 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:29.137549 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-05efa357-3c85-4479-88c9-d9c3611121a3 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] [instance: a541a008-c541-407b-8868-a2b9d98ed15d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:29.144090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05efa357-3c85-4479-88c9-d9c3611121a3 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:29.144555 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05efa357-3c85-4479-88c9-d9c3611121a3 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:29.145335 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05efa357-3c85-4479-88c9-d9c3611121a3 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:29.145792 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05efa357-3c85-4479-88c9-d9c3611121a3 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:29.161336 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-05efa357-3c85-4479-88c9-d9c3611121a3 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] HTTP exception thrown: Instance a541a008-c541-407b-8868-a2b9d98ed15d could not be found. May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-05efa357-3c85-4479-88c9-d9c3611121a3 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Request method failure captured: May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d HTTP/1.1 May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJg6tH3gDv_G0H2GraRX8oQ8lGZuid6X6rCtezUmf7hBAUK2DFLO9AAdjf5w-R-TB33v6W6ypowPRBD4XAsDL-vZ_y-4Dro4FQqjlf1nuDRCynoR69CrsHD6RNXpyOpPEZzNSkHpzOxR_HOpFHYqdQqN4UxXWoQBgrjuixmKydJkC0g May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: c8cbe32e8ede404fa3d19537256606e1 May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-TestShelveInstance-2053479925 May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:33:29.162972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:33:29.164349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c8cbe32e8ede404fa3d19537256606e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c8cbe32e8ede404fa3d19537256606e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c8cbe32e8ede404fa3d19537256606e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c8cbe32e8ede404fa3d19537256606e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:29.164349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-TestShelveInstance-2053479925 May 09 04:33:29.164349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: c8cbe32e8ede404fa3d19537256606e1 May 09 04:33:29.164349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-TestShelveInstance-2053479925 May 09 04:33:29.164349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-TestShelveInstance-2053479925-project May 09 04:33:29.164349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:33:29.164349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:33:29.164349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: dc01367aaf7742d8abdd0fdc4de64f6e May 09 04:33:29.164349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-TestShelveInstance-2053479925-project May 09 04:33:29.164349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:33:29.164349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance a541a008-c541-407b-8868-a2b9d98ed15d could not be found. May 09 04:33:29.164349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': 'a541a008-c541-407b-8868-a2b9d98ed15d'} May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a541a008-c541-407b-8868-a2b9d98ed15d could not be found. May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:29.166060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a541a008-c541-407b-8868-a2b9d98ed15d could not be found. May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a541a008-c541-407b-8868-a2b9d98ed15d could not be found. May 09 04:33:29.167397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:29.171155 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-05efa357-3c85-4479-88c9-d9c3611121a3 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Returning 404 to user: Instance a541a008-c541-407b-8868-a2b9d98ed15d could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:29.171155 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-05efa357-3c85-4479-88c9-d9c3611121a3 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d" status: 404 len: 111 microversion: 2.1 time: 0.032612 May 09 04:33:29.171155 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 496/973] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:29 2022] GET /compute/v2.1/servers/a541a008-c541-407b-8868-a2b9d98ed15d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:33:29.363060 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ec5936a7-41b3-4843-878a-941939639174 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] Calling method '.version_select at 0x7fbfd44bfb80>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:29.409158 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ec5936a7-41b3-4843-878a-941939639174 tempest-TestShelveInstance-2053479925 tempest-TestShelveInstance-2053479925-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-889546097" status: 202 len: 0 microversion: 2.1 time: 0.055751 May 09 04:33:29.411114 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 478/974] 10.222.0.44 () {58 vars in 1250 bytes} [Mon May 9 04:33:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-889546097 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:33:30.771693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3f0e2d9e-3918-458a-8fba-66309d8f6363 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:30.772639 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-3f0e2d9e-3918-458a-8fba-66309d8f6363 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:30.779948 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3f0e2d9e-3918-458a-8fba-66309d8f6363 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:30.780340 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3f0e2d9e-3918-458a-8fba-66309d8f6363 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:30.781293 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3f0e2d9e-3918-458a-8fba-66309d8f6363 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:30.781866 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3f0e2d9e-3918-458a-8fba-66309d8f6363 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:31.000335 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-3f0e2d9e-3918-458a-8fba-66309d8f6363 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.232440 May 09 04:33:31.000913 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 497/975] 10.222.0.44 () {60 vars in 1342 bytes} [Mon May 9 04:33:30 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c/os-volume_attachments => generated 25 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:31.069294 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0cdddd50-056b-4a8e-8589-46cf266c250b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:31.069823 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0cdddd50-056b-4a8e-8589-46cf266c250b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:31.076970 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0cdddd50-056b-4a8e-8589-46cf266c250b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:31.077680 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0cdddd50-056b-4a8e-8589-46cf266c250b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:31.078619 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0cdddd50-056b-4a8e-8589-46cf266c250b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:31.079212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0cdddd50-056b-4a8e-8589-46cf266c250b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:31.114959 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0cdddd50-056b-4a8e-8589-46cf266c250b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:33:31.272244 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0cdddd50-056b-4a8e-8589-46cf266c250b tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "DELETE /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 204 len: 0 microversion: 2.20 time: 0.206690 May 09 04:33:31.272916 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 479/976] 10.222.0.44 () {60 vars in 1279 bytes} [Mon May 9 04:33:31 2022] DELETE /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 04:33:31.283187 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8d3c7cfa-c113-4361-82ed-f2edf8337457 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:31.284243 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8d3c7cfa-c113-4361-82ed-f2edf8337457 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:31.292203 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8d3c7cfa-c113-4361-82ed-f2edf8337457 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:31.293031 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8d3c7cfa-c113-4361-82ed-f2edf8337457 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:31.294034 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8d3c7cfa-c113-4361-82ed-f2edf8337457 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:31.294672 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8d3c7cfa-c113-4361-82ed-f2edf8337457 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:31.683852 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8d3c7cfa-c113-4361-82ed-f2edf8337457 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:31.692398 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8d3c7cfa-c113-4361-82ed-f2edf8337457 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:31.694045 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8d3c7cfa-c113-4361-82ed-f2edf8337457 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:31.695220 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8d3c7cfa-c113-4361-82ed-f2edf8337457 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.417571 May 09 04:33:31.695881 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 498/977] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:33:31 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:33:32.717350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0f44156a-5866-4efc-a5dd-d854361a5aa5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:32.718772 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0f44156a-5866-4efc-a5dd-d854361a5aa5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:32.727729 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f44156a-5866-4efc-a5dd-d854361a5aa5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:32.729005 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f44156a-5866-4efc-a5dd-d854361a5aa5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:32.730558 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f44156a-5866-4efc-a5dd-d854361a5aa5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:32.731665 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f44156a-5866-4efc-a5dd-d854361a5aa5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:32.992246 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0f44156a-5866-4efc-a5dd-d854361a5aa5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:33.001314 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0f44156a-5866-4efc-a5dd-d854361a5aa5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:33.003063 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0f44156a-5866-4efc-a5dd-d854361a5aa5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:33.004469 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0f44156a-5866-4efc-a5dd-d854361a5aa5 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1723 microversion: 2.20 time: 0.294217 May 09 04:33:33.005644 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 480/978] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:33:32 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:33:33.626147 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-232862206", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "networks": [{"uuid": "627ae9bf-4485-4d21-8d33-ad26d60fe27f"}]}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:33.747880 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.network.neutron [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] validate_networks() for [('627ae9bf-4485-4d21-8d33-ad26d60fe27f', None, None, None, None, None)] {{(pid=117033) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:33:33.944568 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e13096ca-8a80-4f1e-9606-611a6c2b8e67 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:33.945121 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e13096ca-8a80-4f1e-9606-611a6c2b8e67 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:33.952973 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e13096ca-8a80-4f1e-9606-611a6c2b8e67 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:33.953651 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e13096ca-8a80-4f1e-9606-611a6c2b8e67 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:33.954579 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e13096ca-8a80-4f1e-9606-611a6c2b8e67 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:33.955220 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e13096ca-8a80-4f1e-9606-611a6c2b8e67 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:34.062004 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-e13096ca-8a80-4f1e-9606-611a6c2b8e67 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lazy-loading 'services' on Instance uuid ac02e597-eed8-41a5-9300-f980ce0cf328 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:33:34.145174 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e13096ca-8a80-4f1e-9606-611a6c2b8e67 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328/os-volume_attachments/ff391078-7e15-426f-bc40-d0e5f3015c7b" status: 202 len: 0 microversion: 2.1 time: 0.205524 May 09 04:33:34.146252 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 481/979] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 04:33:33 2022] DELETE /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328/os-volume_attachments/ff391078-7e15-426f-bc40-d0e5f3015c7b => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 04:33:34.166593 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5583a7b1-dc51-4a21-b55c-2f16a54521bc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:34.167307 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5583a7b1-dc51-4a21-b55c-2f16a54521bc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:34.184740 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5583a7b1-dc51-4a21-b55c-2f16a54521bc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:34.185200 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5583a7b1-dc51-4a21-b55c-2f16a54521bc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:34.186556 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5583a7b1-dc51-4a21-b55c-2f16a54521bc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:34.187282 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5583a7b1-dc51-4a21-b55c-2f16a54521bc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:34.295614 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Flavor limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:33:34.296089 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Image limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:33:34.296563 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Flavor pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:33:34.296976 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Image pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:33:34.297390 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:33:34.299726 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5583a7b1-dc51-4a21-b55c-2f16a54521bc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:34.306791 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:34.307242 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:34.308114 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:34.308577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:34.312224 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5583a7b1-dc51-4a21-b55c-2f16a54521bc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:34.313786 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5583a7b1-dc51-4a21-b55c-2f16a54521bc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:34.314960 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5583a7b1-dc51-4a21-b55c-2f16a54521bc tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1655 microversion: 2.20 time: 0.153664 May 09 04:33:34.315911 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 482/980] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:33:34 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1655 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:33:34.320397 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f1851aa6-36cf-4ea9-8256-26a9dca5b020 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:34.321563 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f1851aa6-36cf-4ea9-8256-26a9dca5b020 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:34.327631 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Getting quotas for project 3d6aeac77b6d4f1c8f912d7c5d91968f. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:33:34.330674 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f1851aa6-36cf-4ea9-8256-26a9dca5b020 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:34.331131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f1851aa6-36cf-4ea9-8256-26a9dca5b020 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:34.331940 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f1851aa6-36cf-4ea9-8256-26a9dca5b020 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:34.332360 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f1851aa6-36cf-4ea9-8256-26a9dca5b020 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:34.332846 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Getting quotas for user ec0360cd80a040c5ae2f3f7a6ba01f75 and project 3d6aeac77b6d4f1c8f912d7c5d91968f. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:33:34.344965 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Going to run 1 instances... {{(pid=117033) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:33:34.347582 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:33:34.363176 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f1851aa6-36cf-4ea9-8256-26a9dca5b020 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046117 May 09 04:33:34.363752 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 483/981] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:33:34 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:33:34.396840 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-4ea019ca-0aa3-4846-a3fe-b717148c429e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775635 May 09 04:33:34.398090 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 499/982] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:33:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:33:34.408262 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-030debcd-bdcb-46d2-b406-d5722d7f89dc tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:34.409174 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-030debcd-bdcb-46d2-b406-d5722d7f89dc tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:34.501529 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-030debcd-bdcb-46d2-b406-d5722d7f89dc tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:34.509571 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-030debcd-bdcb-46d2-b406-d5722d7f89dc tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1218 microversion: 2.1 time: 0.105551 May 09 04:33:34.510409 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 484/983] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:34 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:35.153635 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-fac8346d-8262-45aa-978f-312349752986 req-3c34e310-e8df-4f68-9355-bd94e2b88074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f5900f-cb8a-485d-866b-580b188cc09c", "name": "network-vif-deleted", "tag": "374d080b-906f-4857-97aa-846916239632"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:35.166324 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-fac8346d-8262-45aa-978f-312349752986 req-3c34e310-e8df-4f68-9355-bd94e2b88074 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:35.166987 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-fac8346d-8262-45aa-978f-312349752986 req-3c34e310-e8df-4f68-9355-bd94e2b88074 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:35.184457 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-fac8346d-8262-45aa-978f-312349752986 req-3c34e310-e8df-4f68-9355-bd94e2b88074 service nova] Creating event network-vif-deleted:374d080b-906f-4857-97aa-846916239632 for instance 96f5900f-cb8a-485d-866b-580b188cc09c on hv-cinder-83800 May 09 04:33:35.190447 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-fac8346d-8262-45aa-978f-312349752986 req-3c34e310-e8df-4f68-9355-bd94e2b88074 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043709 May 09 04:33:35.191053 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 500/984] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:33:35.336375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d80e8150-2df6-4079-bd63-12be2bec0217 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:35.338519 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d80e8150-2df6-4079-bd63-12be2bec0217 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:35.349843 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d80e8150-2df6-4079-bd63-12be2bec0217 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:35.351309 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d80e8150-2df6-4079-bd63-12be2bec0217 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:35.352767 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d80e8150-2df6-4079-bd63-12be2bec0217 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:35.354180 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d80e8150-2df6-4079-bd63-12be2bec0217 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:35.381664 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-44d56dd3-c9a3-41d9-8520-e952fa5f5613 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:35.383391 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-44d56dd3-c9a3-41d9-8520-e952fa5f5613 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:35.406316 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-44d56dd3-c9a3-41d9-8520-e952fa5f5613 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:35.409909 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-44d56dd3-c9a3-41d9-8520-e952fa5f5613 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:35.418730 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-44d56dd3-c9a3-41d9-8520-e952fa5f5613 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:35.420371 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-44d56dd3-c9a3-41d9-8520-e952fa5f5613 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:35.477969 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-44d56dd3-c9a3-41d9-8520-e952fa5f5613 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106866 May 09 04:33:35.479394 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 501/985] 10.222.0.44 () {58 vars in 1301 bytes} [Mon May 9 04:33:35 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 04:33:35.536860 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d80e8150-2df6-4079-bd63-12be2bec0217 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:35.543600 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6e3cd237-d262-4fad-a2f6-9e4280874a0a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:35.544368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6e3cd237-d262-4fad-a2f6-9e4280874a0a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:35.550301 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d80e8150-2df6-4079-bd63-12be2bec0217 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:35.566535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d80e8150-2df6-4079-bd63-12be2bec0217 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:35.567569 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6e3cd237-d262-4fad-a2f6-9e4280874a0a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:35.568306 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6e3cd237-d262-4fad-a2f6-9e4280874a0a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:35.569077 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6e3cd237-d262-4fad-a2f6-9e4280874a0a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:35.569511 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6e3cd237-d262-4fad-a2f6-9e4280874a0a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:35.576838 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d80e8150-2df6-4079-bd63-12be2bec0217 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1365 microversion: 2.20 time: 0.245825 May 09 04:33:35.590789 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 485/986] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:33:35 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:33:35.598963 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-98f56aea-fc33-4048-b316-2b0bb1912ff4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:35.600080 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-98f56aea-fc33-4048-b316-2b0bb1912ff4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:35.608883 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-98f56aea-fc33-4048-b316-2b0bb1912ff4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:35.609624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-98f56aea-fc33-4048-b316-2b0bb1912ff4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:35.610631 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-98f56aea-fc33-4048-b316-2b0bb1912ff4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:35.611249 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-98f56aea-fc33-4048-b316-2b0bb1912ff4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:35.672719 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-6e3cd237-d262-4fad-a2f6-9e4280874a0a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:35.676721 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-98f56aea-fc33-4048-b316-2b0bb1912ff4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:33:35.681527 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6e3cd237-d262-4fad-a2f6-9e4280874a0a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1288 microversion: 2.1 time: 0.156650 May 09 04:33:35.682796 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 502/987] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:35 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1288 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:35.813497 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-98f56aea-fc33-4048-b316-2b0bb1912ff4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 204 len: 0 microversion: 2.1 time: 0.221000 May 09 04:33:35.814318 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 486/988] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:33:35 2022] DELETE /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:33:35.822707 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-344953cd-5147-4c4e-afcd-25bed25f602c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:35.823465 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-344953cd-5147-4c4e-afcd-25bed25f602c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:35.830044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-344953cd-5147-4c4e-afcd-25bed25f602c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:35.830810 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-344953cd-5147-4c4e-afcd-25bed25f602c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:35.831835 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-344953cd-5147-4c4e-afcd-25bed25f602c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:35.832402 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-344953cd-5147-4c4e-afcd-25bed25f602c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:35.994465 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-344953cd-5147-4c4e-afcd-25bed25f602c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:36.003454 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-344953cd-5147-4c4e-afcd-25bed25f602c tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1681 microversion: 2.1 time: 0.184486 May 09 04:33:36.004503 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 503/989] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:35 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:36.598835 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b2c7c5e7-e42b-4819-9c6b-f15399b18602 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:36.599611 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b2c7c5e7-e42b-4819-9c6b-f15399b18602 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:36.606412 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b2c7c5e7-e42b-4819-9c6b-f15399b18602 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:36.607048 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b2c7c5e7-e42b-4819-9c6b-f15399b18602 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:36.609189 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b2c7c5e7-e42b-4819-9c6b-f15399b18602 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:36.609641 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b2c7c5e7-e42b-4819-9c6b-f15399b18602 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:36.644189 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b2c7c5e7-e42b-4819-9c6b-f15399b18602 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:36.644710 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b2c7c5e7-e42b-4819-9c6b-f15399b18602 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:36.645111 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-b2c7c5e7-e42b-4819-9c6b-f15399b18602 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lazy-loading 'fault' on Instance uuid 96f5900f-cb8a-485d-866b-580b188cc09c {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:33:36.701263 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-cecb1aa1-7ea8-4b02-b9e0-2a8cec85367c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:36.702669 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-cecb1aa1-7ea8-4b02-b9e0-2a8cec85367c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:36.709072 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cecb1aa1-7ea8-4b02-b9e0-2a8cec85367c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:36.709529 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cecb1aa1-7ea8-4b02-b9e0-2a8cec85367c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:36.710309 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cecb1aa1-7ea8-4b02-b9e0-2a8cec85367c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:36.710753 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cecb1aa1-7ea8-4b02-b9e0-2a8cec85367c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:36.731357 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b2c7c5e7-e42b-4819-9c6b-f15399b18602 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:36.741114 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b2c7c5e7-e42b-4819-9c6b-f15399b18602 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:36.743005 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b2c7c5e7-e42b-4819-9c6b-f15399b18602 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8f6c77f898475e8acf1c4042c3928b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e56ba7f9cc64897a1d95ac15061e9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:36.744480 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b2c7c5e7-e42b-4819-9c6b-f15399b18602 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 200 len: 1370 microversion: 2.20 time: 0.150310 May 09 04:33:36.745580 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 487/990] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:33:36 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 04:33:36.870602 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-cecb1aa1-7ea8-4b02-b9e0-2a8cec85367c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:36.878860 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-cecb1aa1-7ea8-4b02-b9e0-2a8cec85367c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1318 microversion: 2.1 time: 0.181485 May 09 04:33:36.879542 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 504/991] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:36 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:33:37.020775 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1f0c4a0e-d678-4a74-bb5a-514f54fe1f14 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:37.021643 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1f0c4a0e-d678-4a74-bb5a-514f54fe1f14 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:37.027735 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1f0c4a0e-d678-4a74-bb5a-514f54fe1f14 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:37.028395 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1f0c4a0e-d678-4a74-bb5a-514f54fe1f14 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:37.029895 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1f0c4a0e-d678-4a74-bb5a-514f54fe1f14 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:37.030526 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1f0c4a0e-d678-4a74-bb5a-514f54fe1f14 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:37.707123 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1f0c4a0e-d678-4a74-bb5a-514f54fe1f14 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:37.716710 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1f0c4a0e-d678-4a74-bb5a-514f54fe1f14 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1681 microversion: 2.1 time: 0.699706 May 09 04:33:37.717285 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 488/992] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:37 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1681 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:37.764365 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-80928242-a10a-4dc2-b675-aa8b01716925 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:37.765289 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-80928242-a10a-4dc2-b675-aa8b01716925 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:37.772897 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-80928242-a10a-4dc2-b675-aa8b01716925 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:37.773481 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-80928242-a10a-4dc2-b675-aa8b01716925 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:37.774495 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-80928242-a10a-4dc2-b675-aa8b01716925 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:37.774903 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-80928242-a10a-4dc2-b675-aa8b01716925 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:37.790659 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-80928242-a10a-4dc2-b675-aa8b01716925 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] HTTP exception thrown: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-80928242-a10a-4dc2-b675-aa8b01716925 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Request method failure captured: May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c HTTP/1.1 May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJfzsmXPUoXsG1RChTZ1zx5SCuZyA7ohBFF9v0tzYzP1MGXAVRwvMQWm-e9oFPHwtqP7h135tzc6wls5yWPFJ2rttUeZRGRKkLbNpAAkryfCMu9X44EiEvlGmFV1E1b_8HVW4P-QpkBHyII7LnJLGMqrkmk1LGFeSodef3EPfLFeUxE May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Openstack-Nova-Api-Version: 2.20 May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 5e56ba7f9cc64897a1d95ac15061e9e4 May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:33:37.794021 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:33:37.796363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:37.796363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:37.796363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 5e56ba7f9cc64897a1d95ac15061e9e4 May 09 04:33:37.796363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:37.796363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-AttachVolumeShelveTestJSON-769609988-project May 09 04:33:37.796363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:33:37.796363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:33:37.796363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 4f8f6c77f898475e8acf1c4042c3928b May 09 04:33:37.796363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-AttachVolumeShelveTestJSON-769609988-project May 09 04:33:37.796363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:33:37.796363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:37.796363 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': '96f5900f-cb8a-485d-866b-580b188cc09c'} May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:37.797734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:37.799160 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:37.800667 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-80928242-a10a-4dc2-b675-aa8b01716925 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Returning 404 to user: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:37.800667 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-80928242-a10a-4dc2-b675-aa8b01716925 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 404 len: 111 microversion: 2.20 time: 0.035220 May 09 04:33:37.800667 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 505/993] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:33:37 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 04:33:37.806241 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-078fcbd6-99a7-437b-84f2-dfbd7204f126 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '.version_select at 0x7fbfd43b61f0>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:37.825973 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-078fcbd6-99a7-437b-84f2-dfbd7204f126 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-864835392" status: 204 len: 0 microversion: 2.20 time: 0.023307 May 09 04:33:37.828208 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 489/994] 10.222.0.44 () {60 vars in 1258 bytes} [Mon May 9 04:33:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-864835392 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 04:33:37.896519 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d735c2a5-6fcf-427f-b183-1e2ba2a54002 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:37.897344 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d735c2a5-6fcf-427f-b183-1e2ba2a54002 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:37.904314 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d735c2a5-6fcf-427f-b183-1e2ba2a54002 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:37.905052 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d735c2a5-6fcf-427f-b183-1e2ba2a54002 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:37.905989 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d735c2a5-6fcf-427f-b183-1e2ba2a54002 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:37.906566 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d735c2a5-6fcf-427f-b183-1e2ba2a54002 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:38.109872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-d735c2a5-6fcf-427f-b183-1e2ba2a54002 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:38.118348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d735c2a5-6fcf-427f-b183-1e2ba2a54002 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1318 microversion: 2.1 time: 0.225763 May 09 04:33:38.119345 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 506/995] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:37 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:38.735683 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2734614e-aff5-4cda-b216-2f9d4e06bb1e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:38.737077 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2734614e-aff5-4cda-b216-2f9d4e06bb1e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:38.746519 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2734614e-aff5-4cda-b216-2f9d4e06bb1e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:38.747182 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2734614e-aff5-4cda-b216-2f9d4e06bb1e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:38.748749 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2734614e-aff5-4cda-b216-2f9d4e06bb1e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:38.749392 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2734614e-aff5-4cda-b216-2f9d4e06bb1e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:39.136054 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8cab0ab7-9261-4b63-b50c-3c190d75794d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:39.136757 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8cab0ab7-9261-4b63-b50c-3c190d75794d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:39.144096 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8cab0ab7-9261-4b63-b50c-3c190d75794d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:39.144753 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8cab0ab7-9261-4b63-b50c-3c190d75794d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:39.145932 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8cab0ab7-9261-4b63-b50c-3c190d75794d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:39.146604 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8cab0ab7-9261-4b63-b50c-3c190d75794d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:39.276193 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2734614e-aff5-4cda-b216-2f9d4e06bb1e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:39.285692 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2734614e-aff5-4cda-b216-2f9d4e06bb1e tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1681 microversion: 2.1 time: 0.555509 May 09 04:33:39.286939 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 490/996] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:38 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1681 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:39.299348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8cab0ab7-9261-4b63-b50c-3c190d75794d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:39.306626 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8cab0ab7-9261-4b63-b50c-3c190d75794d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1318 microversion: 2.1 time: 0.174573 May 09 04:33:39.307819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 507/997] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:39 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:40.074142 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-315c7d3d-e3e7-470b-96d4-2fa0298ff209 req-d0debfcc-353d-4c90-b428-0c78e17b65fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c3132a4-8591-418d-8efe-7148c942eb3f", "tag": "5c419669-8aea-4b2e-9dd3-40cafa53920b"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:40.086854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-315c7d3d-e3e7-470b-96d4-2fa0298ff209 req-d0debfcc-353d-4c90-b428-0c78e17b65fd service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:40.087291 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-315c7d3d-e3e7-470b-96d4-2fa0298ff209 req-d0debfcc-353d-4c90-b428-0c78e17b65fd service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:40.123561 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-315c7d3d-e3e7-470b-96d4-2fa0298ff209 req-d0debfcc-353d-4c90-b428-0c78e17b65fd service nova] Creating event network-changed:5c419669-8aea-4b2e-9dd3-40cafa53920b for instance 2c3132a4-8591-418d-8efe-7148c942eb3f on hv-cinder-83800 May 09 04:33:40.136303 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-315c7d3d-e3e7-470b-96d4-2fa0298ff209 req-d0debfcc-353d-4c90-b428-0c78e17b65fd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065650 May 09 04:33:40.137988 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 491/998] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:33:40.304600 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1ccfbf39-3032-4b20-b087-dec79e4a2fa4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:40.305336 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1ccfbf39-3032-4b20-b087-dec79e4a2fa4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:40.324953 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e34f454c-3bfe-4d97-84ad-483cbd202ff2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:40.326857 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e34f454c-3bfe-4d97-84ad-483cbd202ff2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:40.331374 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1ccfbf39-3032-4b20-b087-dec79e4a2fa4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:40.333175 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1ccfbf39-3032-4b20-b087-dec79e4a2fa4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:40.334216 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1ccfbf39-3032-4b20-b087-dec79e4a2fa4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:40.334871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1ccfbf39-3032-4b20-b087-dec79e4a2fa4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:40.342826 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e34f454c-3bfe-4d97-84ad-483cbd202ff2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:40.344585 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e34f454c-3bfe-4d97-84ad-483cbd202ff2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:40.347996 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e34f454c-3bfe-4d97-84ad-483cbd202ff2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:40.350350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e34f454c-3bfe-4d97-84ad-483cbd202ff2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:40.443603 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1ccfbf39-3032-4b20-b087-dec79e4a2fa4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:40.453062 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1ccfbf39-3032-4b20-b087-dec79e4a2fa4 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1613 microversion: 2.1 time: 0.152927 May 09 04:33:40.465399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 508/999] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:40 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1613 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:40.832812 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e34f454c-3bfe-4d97-84ad-483cbd202ff2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:40.847533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e34f454c-3bfe-4d97-84ad-483cbd202ff2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1318 microversion: 2.1 time: 0.526985 May 09 04:33:40.848916 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 492/1000] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:40 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:41.359401 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-07fa5593-fb19-4995-928a-c6969d958285 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:41.369809 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-07fa5593-fb19-4995-928a-c6969d958285 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:41.381939 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-07fa5593-fb19-4995-928a-c6969d958285 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:41.384405 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-07fa5593-fb19-4995-928a-c6969d958285 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:41.390479 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-07fa5593-fb19-4995-928a-c6969d958285 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:41.391131 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-07fa5593-fb19-4995-928a-c6969d958285 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:41.413898 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-07fa5593-fb19-4995-928a-c6969d958285 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] HTTP exception thrown: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-07fa5593-fb19-4995-928a-c6969d958285 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Request method failure captured: May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: DELETE /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c HTTP/1.1 May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJfzsmXPUoXsG1RChTZ1zx5SCuZyA7ohBFF9v0tzYzP1MGXAVRwvMQWm-e9oFPHwtqP7h135tzc6wls5yWPFJ2rttUeZRGRKkLbNpAAkryfCMu9X44EiEvlGmFV1E1b_8HVW4P-QpkBHyII7LnJLGMqrkmk1LGFeSodef3EPfLFeUxE May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Openstack-Nova-Api-Version: 2.20 May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 5e56ba7f9cc64897a1d95ac15061e9e4 May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:33:41.415823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:33:41.417550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:41.417550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:41.417550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 5e56ba7f9cc64897a1d95ac15061e9e4 May 09 04:33:41.417550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:41.417550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-AttachVolumeShelveTestJSON-769609988-project May 09 04:33:41.417550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:33:41.417550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:33:41.417550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 4f8f6c77f898475e8acf1c4042c3928b May 09 04:33:41.417550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-AttachVolumeShelveTestJSON-769609988-project May 09 04:33:41.417550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:33:41.417550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:41.417550 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': '96f5900f-cb8a-485d-866b-580b188cc09c'} May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:41.418411 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:41.421082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:41.422816 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-07fa5593-fb19-4995-928a-c6969d958285 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Returning 404 to user: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:41.422816 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-07fa5593-fb19-4995-928a-c6969d958285 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "DELETE /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 404 len: 111 microversion: 2.20 time: 0.063085 May 09 04:33:41.422816 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 509/1001] 10.222.0.44 () {60 vars in 1279 bytes} [Mon May 9 04:33:41 2022] DELETE /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 04:33:41.450724 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5ac99d5e-29f8-4bee-a3bc-5f2af4f5c7de tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:41.453072 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5ac99d5e-29f8-4bee-a3bc-5f2af4f5c7de tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: 96f5900f-cb8a-485d-866b-580b188cc09c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:41.463773 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5ac99d5e-29f8-4bee-a3bc-5f2af4f5c7de tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:41.464993 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5ac99d5e-29f8-4bee-a3bc-5f2af4f5c7de tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:41.467564 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5ac99d5e-29f8-4bee-a3bc-5f2af4f5c7de tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:41.468520 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5ac99d5e-29f8-4bee-a3bc-5f2af4f5c7de tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:41.472089 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c31b80d9-6c42-45b1-986e-4e238ffe4fbf tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:41.473103 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c31b80d9-6c42-45b1-986e-4e238ffe4fbf tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:41.486449 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c31b80d9-6c42-45b1-986e-4e238ffe4fbf tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:41.487071 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c31b80d9-6c42-45b1-986e-4e238ffe4fbf tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:41.488035 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c31b80d9-6c42-45b1-986e-4e238ffe4fbf tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:41.488475 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c31b80d9-6c42-45b1-986e-4e238ffe4fbf tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:41.488797 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-5ac99d5e-29f8-4bee-a3bc-5f2af4f5c7de tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] HTTP exception thrown: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5ac99d5e-29f8-4bee-a3bc-5f2af4f5c7de tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Request method failure captured: May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c HTTP/1.1 May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJfzsmXPUoXsG1RChTZ1zx5SCuZyA7ohBFF9v0tzYzP1MGXAVRwvMQWm-e9oFPHwtqP7h135tzc6wls5yWPFJ2rttUeZRGRKkLbNpAAkryfCMu9X44EiEvlGmFV1E1b_8HVW4P-QpkBHyII7LnJLGMqrkmk1LGFeSodef3EPfLFeUxE May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Openstack-Nova-Api-Version: 2.20 May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 5e56ba7f9cc64897a1d95ac15061e9e4 May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:33:41.490597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:33:41.492166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:41.492166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:41.492166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 5e56ba7f9cc64897a1d95ac15061e9e4 May 09 04:33:41.492166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:41.492166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-AttachVolumeShelveTestJSON-769609988-project May 09 04:33:41.492166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:33:41.492166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:33:41.492166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 4f8f6c77f898475e8acf1c4042c3928b May 09 04:33:41.492166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-AttachVolumeShelveTestJSON-769609988-project May 09 04:33:41.492166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:33:41.492166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:41.492166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '96f5900f-cb8a-485d-866b-580b188cc09c'} May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:41.492950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. May 09 04:33:41.494229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:41.495512 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5ac99d5e-29f8-4bee-a3bc-5f2af4f5c7de tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Returning 404 to user: Instance 96f5900f-cb8a-485d-866b-580b188cc09c could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:41.496605 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5ac99d5e-29f8-4bee-a3bc-5f2af4f5c7de tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c" status: 404 len: 111 microversion: 2.20 time: 0.072382 May 09 04:33:41.500551 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 493/1002] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:33:41 2022] GET /compute/v2.1/servers/96f5900f-cb8a-485d-866b-580b188cc09c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 04:33:41.550022 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c31b80d9-6c42-45b1-986e-4e238ffe4fbf tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:41.550543 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c31b80d9-6c42-45b1-986e-4e238ffe4fbf tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:41.551004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.objects.instance [None req-c31b80d9-6c42-45b1-986e-4e238ffe4fbf tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lazy-loading 'fault' on Instance uuid ac02e597-eed8-41a5-9300-f980ce0cf328 {{(pid=117033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:33:41.620029 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c31b80d9-6c42-45b1-986e-4e238ffe4fbf tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56a403eeee84720ba765e2d4367df74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c83b0a8b88f452f9e12d077e8ac28c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:41.633476 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c31b80d9-6c42-45b1-986e-4e238ffe4fbf tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 200 len: 1331 microversion: 2.1 time: 0.165583 May 09 04:33:41.634435 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 510/1003] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:41 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 1331 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:41.864159 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8c507c84-f0d1-4b99-83b2-3febc55d71d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:41.864783 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8c507c84-f0d1-4b99-83b2-3febc55d71d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:41.874288 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8c507c84-f0d1-4b99-83b2-3febc55d71d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:41.874706 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8c507c84-f0d1-4b99-83b2-3febc55d71d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:41.875504 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8c507c84-f0d1-4b99-83b2-3febc55d71d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:41.875977 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8c507c84-f0d1-4b99-83b2-3febc55d71d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:42.175465 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-fdb151eb-7b10-4991-b67e-70ec6984b50e req-a888e3fe-2362-4635-83d9-969092b3a493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac02e597-eed8-41a5-9300-f980ce0cf328", "name": "network-vif-deleted", "tag": "114b3c19-9453-4537-b992-5d2737a6d6f4"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:42.181966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8c507c84-f0d1-4b99-83b2-3febc55d71d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:42.185644 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-fdb151eb-7b10-4991-b67e-70ec6984b50e req-a888e3fe-2362-4635-83d9-969092b3a493 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:42.186280 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-fdb151eb-7b10-4991-b67e-70ec6984b50e req-a888e3fe-2362-4635-83d9-969092b3a493 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:42.192785 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8c507c84-f0d1-4b99-83b2-3febc55d71d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1318 microversion: 2.1 time: 0.332437 May 09 04:33:42.193369 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 494/1004] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:41 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:42.205329 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-fdb151eb-7b10-4991-b67e-70ec6984b50e req-a888e3fe-2362-4635-83d9-969092b3a493 service nova] Creating event network-vif-deleted:114b3c19-9453-4537-b992-5d2737a6d6f4 for instance ac02e597-eed8-41a5-9300-f980ce0cf328 on hv-cinder-83800 May 09 04:33:42.215257 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-fdb151eb-7b10-4991-b67e-70ec6984b50e req-a888e3fe-2362-4635-83d9-969092b3a493 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044290 May 09 04:33:42.215861 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 511/1005] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:33:42.650531 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0eb9d704-21b9-4de6-9c28-c332df8ce55a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:42.651432 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0eb9d704-21b9-4de6-9c28-c332df8ce55a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:42.658134 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0eb9d704-21b9-4de6-9c28-c332df8ce55a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:42.658570 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0eb9d704-21b9-4de6-9c28-c332df8ce55a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:42.659344 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0eb9d704-21b9-4de6-9c28-c332df8ce55a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:42.659986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0eb9d704-21b9-4de6-9c28-c332df8ce55a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:42.675100 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-0eb9d704-21b9-4de6-9c28-c332df8ce55a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] HTTP exception thrown: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0eb9d704-21b9-4de6-9c28-c332df8ce55a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Request method failure captured: May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 HTTP/1.1 May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJhTbCVgTT3HZuxvtZpJ_cLiO-p5aO5ZCrkaJhYtCXNfzo_IXS3499vPTrl-cgrMt-SnaVL5V4wtRTXaaPRZskqvbSNvwlk-mrGJOcozoTU2E5zQ45dYOd-AEzlNKKX4qka08Rdzwq7NFgcZCZDko0TOyv7hyBbf4It5Ltr84wDaqIk May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:33:42.677033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:33:42.678626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:42.678626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:42.678626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:42.678626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:42.678626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:42.678626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:33:42.678626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:33:42.678626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: c56a403eeee84720ba765e2d4367df74 May 09 04:33:42.678626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:42.678626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:33:42.678626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:42.678626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': 'ac02e597-eed8-41a5-9300-f980ce0cf328'} May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:42.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:42.681000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:42.682922 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0eb9d704-21b9-4de6-9c28-c332df8ce55a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Returning 404 to user: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:42.683957 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0eb9d704-21b9-4de6-9c28-c332df8ce55a tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 404 len: 111 microversion: 2.1 time: 0.037282 May 09 04:33:42.684674 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 495/1006] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:42 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:33:42.694577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5db5c306-dc84-4d82-afc1-268b2a7ba656 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '.version_select at 0x7fbfd96c29d0>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:42.703139 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7d9bc960-62e6-4dac-ae85-28427e1a9e2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:42.703644 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7d9bc960-62e6-4dac-ae85-28427e1a9e2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:42.710557 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7d9bc960-62e6-4dac-ae85-28427e1a9e2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:42.711007 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7d9bc960-62e6-4dac-ae85-28427e1a9e2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:42.711811 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7d9bc960-62e6-4dac-ae85-28427e1a9e2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:42.712355 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7d9bc960-62e6-4dac-ae85-28427e1a9e2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:42.717946 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5db5c306-dc84-4d82-afc1-268b2a7ba656 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-727369245" status: 202 len: 0 microversion: 2.1 time: 0.026942 May 09 04:33:42.719146 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 512/1007] 10.222.0.44 () {58 vars in 1217 bytes} [Mon May 9 04:33:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-727369245 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:33:42.733221 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-7d9bc960-62e6-4dac-ae85-28427e1a9e2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] HTTP exception thrown: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7d9bc960-62e6-4dac-ae85-28427e1a9e2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Request method failure captured: May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: DELETE /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 HTTP/1.1 May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJfzsmXPUoXsG1RChTZ1zx5SCuZyA7ohBFF9v0tzYzP1MGXAVRwvMQWm-e9oFPHwtqP7h135tzc6wls5yWPFJ2rttUeZRGRKkLbNpAAkryfCMu9X44EiEvlGmFV1E1b_8HVW4P-QpkBHyII7LnJLGMqrkmk1LGFeSodef3EPfLFeUxE May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Openstack-Nova-Api-Version: 2.20 May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 5e56ba7f9cc64897a1d95ac15061e9e4 May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:33:42.735297 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:33:42.737131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:42.737131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:42.737131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 5e56ba7f9cc64897a1d95ac15061e9e4 May 09 04:33:42.737131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:42.737131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-AttachVolumeShelveTestJSON-769609988-project May 09 04:33:42.737131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:33:42.737131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:33:42.737131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 4f8f6c77f898475e8acf1c4042c3928b May 09 04:33:42.737131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-AttachVolumeShelveTestJSON-769609988-project May 09 04:33:42.737131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:33:42.737131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:33:42.737131 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': 'd10350c6-bf15-414f-9bf7-d371b6912be2'} May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:42.738000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:33:42.739790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:42.742005 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7d9bc960-62e6-4dac-ae85-28427e1a9e2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Returning 404 to user: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:42.742005 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7d9bc960-62e6-4dac-ae85-28427e1a9e2e tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 404 len: 111 microversion: 2.20 time: 0.039247 May 09 04:33:42.742005 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 496/1008] 10.222.0.44 () {60 vars in 1279 bytes} [Mon May 9 04:33:42 2022] DELETE /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 04:33:42.754494 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-0460a369-9fcf-4f72-83c2-3cf56a69e3b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:42.755529 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-0460a369-9fcf-4f72-83c2-3cf56a69e3b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] [instance: d10350c6-bf15-414f-9bf7-d371b6912be2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:42.762904 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0460a369-9fcf-4f72-83c2-3cf56a69e3b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:42.763924 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0460a369-9fcf-4f72-83c2-3cf56a69e3b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:42.764729 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0460a369-9fcf-4f72-83c2-3cf56a69e3b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:42.765173 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-0460a369-9fcf-4f72-83c2-3cf56a69e3b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:42.786467 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-0460a369-9fcf-4f72-83c2-3cf56a69e3b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] HTTP exception thrown: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-0460a369-9fcf-4f72-83c2-3cf56a69e3b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Request method failure captured: May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 HTTP/1.1 May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJfzsmXPUoXsG1RChTZ1zx5SCuZyA7ohBFF9v0tzYzP1MGXAVRwvMQWm-e9oFPHwtqP7h135tzc6wls5yWPFJ2rttUeZRGRKkLbNpAAkryfCMu9X44EiEvlGmFV1E1b_8HVW4P-QpkBHyII7LnJLGMqrkmk1LGFeSodef3EPfLFeUxE May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Openstack-Nova-Api-Version: 2.20 May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 5e56ba7f9cc64897a1d95ac15061e9e4 May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:33:42.788190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:33:42.789801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5e56ba7f9cc64897a1d95ac15061e9e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:42.789801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:42.789801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 5e56ba7f9cc64897a1d95ac15061e9e4 May 09 04:33:42.789801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-769609988 May 09 04:33:42.789801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-AttachVolumeShelveTestJSON-769609988-project May 09 04:33:42.789801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:33:42.789801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:33:42.789801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 4f8f6c77f898475e8acf1c4042c3928b May 09 04:33:42.789801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-AttachVolumeShelveTestJSON-769609988-project May 09 04:33:42.789801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:33:42.789801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:33:42.789801 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': 'd10350c6-bf15-414f-9bf7-d371b6912be2'} May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:42.790786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. May 09 04:33:42.792190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:42.793425 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-0460a369-9fcf-4f72-83c2-3cf56a69e3b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] Returning 404 to user: Instance d10350c6-bf15-414f-9bf7-d371b6912be2 could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:42.793425 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-0460a369-9fcf-4f72-83c2-3cf56a69e3b9 tempest-AttachVolumeShelveTestJSON-769609988 tempest-AttachVolumeShelveTestJSON-769609988-project] 10.222.0.44 "GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2" status: 404 len: 111 microversion: 2.20 time: 0.045582 May 09 04:33:42.793425 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 513/1009] 10.222.0.44 () {60 vars in 1276 bytes} [Mon May 9 04:33:42 2022] GET /compute/v2.1/servers/d10350c6-bf15-414f-9bf7-d371b6912be2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 04:33:43.210080 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8915794c-4765-4885-8655-9e6fbf6fcceb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:43.210695 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8915794c-4765-4885-8655-9e6fbf6fcceb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:43.216947 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8915794c-4765-4885-8655-9e6fbf6fcceb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:43.217504 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8915794c-4765-4885-8655-9e6fbf6fcceb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:43.218294 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8915794c-4765-4885-8655-9e6fbf6fcceb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:43.218737 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8915794c-4765-4885-8655-9e6fbf6fcceb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:43.432769 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8915794c-4765-4885-8655-9e6fbf6fcceb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:43.446461 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8915794c-4765-4885-8655-9e6fbf6fcceb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1318 microversion: 2.1 time: 0.240053 May 09 04:33:43.447485 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 497/1010] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:43 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:33:44.465014 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-2094bf8e-5747-4fcc-b1a9-ed9f419970f6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:44.465773 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-2094bf8e-5747-4fcc-b1a9-ed9f419970f6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:44.472771 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2094bf8e-5747-4fcc-b1a9-ed9f419970f6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:44.473303 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2094bf8e-5747-4fcc-b1a9-ed9f419970f6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:44.474655 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2094bf8e-5747-4fcc-b1a9-ed9f419970f6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:44.475153 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-2094bf8e-5747-4fcc-b1a9-ed9f419970f6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:44.628484 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-2094bf8e-5747-4fcc-b1a9-ed9f419970f6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:44.635997 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-2094bf8e-5747-4fcc-b1a9-ed9f419970f6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1318 microversion: 2.1 time: 0.175184 May 09 04:33:44.646095 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 514/1011] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:44 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:44.656434 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c2280e8b-f4ee-4230-8b29-29e9988d3cc7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:44.657640 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c2280e8b-f4ee-4230-8b29-29e9988d3cc7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:44.664737 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c2280e8b-f4ee-4230-8b29-29e9988d3cc7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:44.665181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c2280e8b-f4ee-4230-8b29-29e9988d3cc7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:44.665951 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c2280e8b-f4ee-4230-8b29-29e9988d3cc7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:44.666391 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c2280e8b-f4ee-4230-8b29-29e9988d3cc7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:44.681473 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-c2280e8b-f4ee-4230-8b29-29e9988d3cc7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] HTTP exception thrown: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c2280e8b-f4ee-4230-8b29-29e9988d3cc7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Request method failure captured: May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: DELETE /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 HTTP/1.1 May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJhTbCVgTT3HZuxvtZpJ_cLiO-p5aO5ZCrkaJhYtCXNfzo_IXS3499vPTrl-cgrMt-SnaVL5V4wtRTXaaPRZskqvbSNvwlk-mrGJOcozoTU2E5zQ45dYOd-AEzlNKKX4qka08Rdzwq7NFgcZCZDko0TOyv7hyBbf4It5Ltr84wDaqIk May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:33:44.683603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:33:44.685299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:44.685299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:44.685299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:44.685299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:44.685299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:44.685299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:33:44.685299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:33:44.685299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: c56a403eeee84720ba765e2d4367df74 May 09 04:33:44.685299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:44.685299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:33:44.685299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:44.685299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': 'ac02e597-eed8-41a5-9300-f980ce0cf328'} May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:44.686913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:44.688603 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:44.690904 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c2280e8b-f4ee-4230-8b29-29e9988d3cc7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Returning 404 to user: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:44.692043 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c2280e8b-f4ee-4230-8b29-29e9988d3cc7 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 404 len: 111 microversion: 2.1 time: 0.039610 May 09 04:33:44.692701 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 498/1012] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:33:44 2022] DELETE /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:33:44.701504 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b7d84b01-42e1-4e22-bfe4-0a473ee71f72 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:44.702347 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b7d84b01-42e1-4e22-bfe4-0a473ee71f72 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: ac02e597-eed8-41a5-9300-f980ce0cf328] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:44.708936 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b7d84b01-42e1-4e22-bfe4-0a473ee71f72 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:44.709463 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b7d84b01-42e1-4e22-bfe4-0a473ee71f72 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:44.710556 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b7d84b01-42e1-4e22-bfe4-0a473ee71f72 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:44.711296 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b7d84b01-42e1-4e22-bfe4-0a473ee71f72 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:44.727163 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-b7d84b01-42e1-4e22-bfe4-0a473ee71f72 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] HTTP exception thrown: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b7d84b01-42e1-4e22-bfe4-0a473ee71f72 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Request method failure captured: May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 HTTP/1.1 May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJhTbCVgTT3HZuxvtZpJ_cLiO-p5aO5ZCrkaJhYtCXNfzo_IXS3499vPTrl-cgrMt-SnaVL5V4wtRTXaaPRZskqvbSNvwlk-mrGJOcozoTU2E5zQ45dYOd-AEzlNKKX4qka08Rdzwq7NFgcZCZDko0TOyv7hyBbf4It5Ltr84wDaqIk May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:33:44.729012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:33:44.730538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:44.730538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:44.730538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:44.730538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:44.730538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:44.730538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:33:44.730538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:33:44.730538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: c56a403eeee84720ba765e2d4367df74 May 09 04:33:44.730538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:44.730538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:33:44.730538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:44.730538 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': 'ac02e597-eed8-41a5-9300-f980ce0cf328'} May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:44.731368 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. May 09 04:33:44.732819 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:44.735041 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b7d84b01-42e1-4e22-bfe4-0a473ee71f72 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Returning 404 to user: Instance ac02e597-eed8-41a5-9300-f980ce0cf328 could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:44.735041 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b7d84b01-42e1-4e22-bfe4-0a473ee71f72 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328" status: 404 len: 111 microversion: 2.1 time: 0.033963 May 09 04:33:44.735041 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 515/1013] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:44 2022] GET /compute/v2.1/servers/ac02e597-eed8-41a5-9300-f980ce0cf328 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:33:45.653460 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-63239576-c85e-4c5c-ab32-3ca26d28de4d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:45.654983 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-63239576-c85e-4c5c-ab32-3ca26d28de4d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:45.661468 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-63239576-c85e-4c5c-ab32-3ca26d28de4d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:45.662596 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-63239576-c85e-4c5c-ab32-3ca26d28de4d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:45.663553 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-63239576-c85e-4c5c-ab32-3ca26d28de4d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:45.664172 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-63239576-c85e-4c5c-ab32-3ca26d28de4d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:45.805691 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-48998bc1-2a53-468b-84d8-8cdc2017a093 req-7dce5158-2a5b-41ec-8ad5-bd9e1fec6a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c3132a4-8591-418d-8efe-7148c942eb3f", "name": "network-vif-plugged", "status": "completed", "tag": "5c419669-8aea-4b2e-9dd3-40cafa53920b"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:45.830690 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-48998bc1-2a53-468b-84d8-8cdc2017a093 req-7dce5158-2a5b-41ec-8ad5-bd9e1fec6a19 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:45.831020 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-48998bc1-2a53-468b-84d8-8cdc2017a093 req-7dce5158-2a5b-41ec-8ad5-bd9e1fec6a19 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:45.844665 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-48998bc1-2a53-468b-84d8-8cdc2017a093 req-7dce5158-2a5b-41ec-8ad5-bd9e1fec6a19 service nova] Creating event network-vif-plugged:5c419669-8aea-4b2e-9dd3-40cafa53920b for instance 2c3132a4-8591-418d-8efe-7148c942eb3f on hv-cinder-83800 May 09 04:33:45.874149 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-48998bc1-2a53-468b-84d8-8cdc2017a093 req-7dce5158-2a5b-41ec-8ad5-bd9e1fec6a19 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070044 May 09 04:33:45.875321 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 516/1014] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:33:45.897864 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-31b6c029-8f34-40ff-8161-e6fe063e1ed6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:45.899091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-31b6c029-8f34-40ff-8161-e6fe063e1ed6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:45.906710 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-31b6c029-8f34-40ff-8161-e6fe063e1ed6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:45.907559 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-31b6c029-8f34-40ff-8161-e6fe063e1ed6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:45.908938 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-31b6c029-8f34-40ff-8161-e6fe063e1ed6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:45.909746 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-31b6c029-8f34-40ff-8161-e6fe063e1ed6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:45.927561 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-31b6c029-8f34-40ff-8161-e6fe063e1ed6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] HTTP exception thrown: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-31b6c029-8f34-40ff-8161-e6fe063e1ed6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Request method failure captured: May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: DELETE /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 HTTP/1.1 May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJhTbCVgTT3HZuxvtZpJ_cLiO-p5aO5ZCrkaJhYtCXNfzo_IXS3499vPTrl-cgrMt-SnaVL5V4wtRTXaaPRZskqvbSNvwlk-mrGJOcozoTU2E5zQ45dYOd-AEzlNKKX4qka08Rdzwq7NFgcZCZDko0TOyv7hyBbf4It5Ltr84wDaqIk May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:33:45.932337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:33:45.933896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:45.933896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:45.933896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:45.933896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:45.933896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:45.933896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:33:45.933896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:33:45.933896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: c56a403eeee84720ba765e2d4367df74 May 09 04:33:45.933896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:45.933896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:33:45.933896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:33:45.933896 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': '8206836d-7fa2-48b8-8d4c-46c70608a3e0'} May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:45.934782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:33:45.936906 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:45.938549 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-31b6c029-8f34-40ff-8161-e6fe063e1ed6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Returning 404 to user: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:45.938549 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-31b6c029-8f34-40ff-8161-e6fe063e1ed6 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 404 len: 111 microversion: 2.1 time: 0.046840 May 09 04:33:45.938549 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 517/1015] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:33:45 2022] DELETE /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 04:33:45.939547 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-63239576-c85e-4c5c-ab32-3ca26d28de4d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:45.946989 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ac771be2-9dc5-4795-b689-583d5fdeef35 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:45.948470 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ac771be2-9dc5-4795-b689-583d5fdeef35 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 8206836d-7fa2-48b8-8d4c-46c70608a3e0] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:45.949056 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-63239576-c85e-4c5c-ab32-3ca26d28de4d tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1318 microversion: 2.1 time: 0.299163 May 09 04:33:45.950204 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 499/1016] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:45 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:45.954953 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ac771be2-9dc5-4795-b689-583d5fdeef35 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:45.955402 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ac771be2-9dc5-4795-b689-583d5fdeef35 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:45.956198 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ac771be2-9dc5-4795-b689-583d5fdeef35 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:45.956683 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ac771be2-9dc5-4795-b689-583d5fdeef35 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:45.972413 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-ac771be2-9dc5-4795-b689-583d5fdeef35 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] HTTP exception thrown: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ac771be2-9dc5-4795-b689-583d5fdeef35 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Request method failure captured: May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 HTTP/1.1 May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJhTbCVgTT3HZuxvtZpJ_cLiO-p5aO5ZCrkaJhYtCXNfzo_IXS3499vPTrl-cgrMt-SnaVL5V4wtRTXaaPRZskqvbSNvwlk-mrGJOcozoTU2E5zQ45dYOd-AEzlNKKX4qka08Rdzwq7NFgcZCZDko0TOyv7hyBbf4It5Ltr84wDaqIk May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:33:45.974612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:33:45.975942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:45.975942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:45.975942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:45.975942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:45.975942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:45.975942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:33:45.975942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:33:45.975942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: c56a403eeee84720ba765e2d4367df74 May 09 04:33:45.975942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:45.975942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:33:45.975942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:33:45.975942 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': '8206836d-7fa2-48b8-8d4c-46c70608a3e0'} May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:45.976682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. May 09 04:33:45.977871 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:45.978911 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ac771be2-9dc5-4795-b689-583d5fdeef35 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Returning 404 to user: Instance 8206836d-7fa2-48b8-8d4c-46c70608a3e0 could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:45.978911 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ac771be2-9dc5-4795-b689-583d5fdeef35 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0" status: 404 len: 111 microversion: 2.1 time: 0.033332 May 09 04:33:45.978911 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 518/1017] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:45 2022] GET /compute/v2.1/servers/8206836d-7fa2-48b8-8d4c-46c70608a3e0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 04:33:45.985956 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-976a0d9d-eb6f-45a4-a67b-4075fd753a7b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:45.986543 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-976a0d9d-eb6f-45a4-a67b-4075fd753a7b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:45.993427 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-976a0d9d-eb6f-45a4-a67b-4075fd753a7b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:45.994193 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-976a0d9d-eb6f-45a4-a67b-4075fd753a7b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:45.995064 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-976a0d9d-eb6f-45a4-a67b-4075fd753a7b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:45.995581 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-976a0d9d-eb6f-45a4-a67b-4075fd753a7b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:46.010022 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-976a0d9d-eb6f-45a4-a67b-4075fd753a7b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] HTTP exception thrown: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-976a0d9d-eb6f-45a4-a67b-4075fd753a7b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Request method failure captured: May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: DELETE /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d HTTP/1.1 May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJhTbCVgTT3HZuxvtZpJ_cLiO-p5aO5ZCrkaJhYtCXNfzo_IXS3499vPTrl-cgrMt-SnaVL5V4wtRTXaaPRZskqvbSNvwlk-mrGJOcozoTU2E5zQ45dYOd-AEzlNKKX4qka08Rdzwq7NFgcZCZDko0TOyv7hyBbf4It5Ltr84wDaqIk May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:33:46.011686 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:33:46.013184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:46.013184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:46.013184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:46.013184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:46.013184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:46.013184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:33:46.013184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:33:46.013184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: c56a403eeee84720ba765e2d4367df74 May 09 04:33:46.013184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:46.013184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:33:46.013184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:33:46.013184 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': 'c42b820f-fd46-4c3a-bbef-65871250c13d'} May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:46.014098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:33:46.015451 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:46.016733 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-976a0d9d-eb6f-45a4-a67b-4075fd753a7b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Returning 404 to user: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:46.016733 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-976a0d9d-eb6f-45a4-a67b-4075fd753a7b tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 404 len: 111 microversion: 2.1 time: 0.032157 May 09 04:33:46.016733 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 500/1018] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:33:45 2022] DELETE /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:33:46.022797 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8581064b-7114-49b6-99ba-e88cc14728ac tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:46.023416 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8581064b-7114-49b6-99ba-e88cc14728ac tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: c42b820f-fd46-4c3a-bbef-65871250c13d] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:46.029679 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8581064b-7114-49b6-99ba-e88cc14728ac tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:46.030078 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8581064b-7114-49b6-99ba-e88cc14728ac tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:46.031190 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8581064b-7114-49b6-99ba-e88cc14728ac tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:46.031635 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8581064b-7114-49b6-99ba-e88cc14728ac tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:46.047616 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-8581064b-7114-49b6-99ba-e88cc14728ac tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] HTTP exception thrown: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8581064b-7114-49b6-99ba-e88cc14728ac tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Request method failure captured: May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d HTTP/1.1 May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJhTbCVgTT3HZuxvtZpJ_cLiO-p5aO5ZCrkaJhYtCXNfzo_IXS3499vPTrl-cgrMt-SnaVL5V4wtRTXaaPRZskqvbSNvwlk-mrGJOcozoTU2E5zQ45dYOd-AEzlNKKX4qka08Rdzwq7NFgcZCZDko0TOyv7hyBbf4It5Ltr84wDaqIk May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:33:46.049219 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:33:46.050821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:46.050821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:46.050821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:46.050821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:46.050821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:46.050821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:33:46.050821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:33:46.050821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: c56a403eeee84720ba765e2d4367df74 May 09 04:33:46.050821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:46.050821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:33:46.050821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:33:46.050821 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': 'c42b820f-fd46-4c3a-bbef-65871250c13d'} May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:46.051875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. May 09 04:33:46.053091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:46.054618 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8581064b-7114-49b6-99ba-e88cc14728ac tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Returning 404 to user: Instance c42b820f-fd46-4c3a-bbef-65871250c13d could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:46.054618 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8581064b-7114-49b6-99ba-e88cc14728ac tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d" status: 404 len: 111 microversion: 2.1 time: 0.032244 May 09 04:33:46.054618 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 519/1019] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:46 2022] GET /compute/v2.1/servers/c42b820f-fd46-4c3a-bbef-65871250c13d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:33:46.966218 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-462a14be-350c-43f3-abfe-c93967bd85b2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:46.966879 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-462a14be-350c-43f3-abfe-c93967bd85b2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:46.973323 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-462a14be-350c-43f3-abfe-c93967bd85b2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:46.973776 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-462a14be-350c-43f3-abfe-c93967bd85b2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:46.974545 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-462a14be-350c-43f3-abfe-c93967bd85b2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:46.975033 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-462a14be-350c-43f3-abfe-c93967bd85b2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:47.144763 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-462a14be-350c-43f3-abfe-c93967bd85b2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:47.152180 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-462a14be-350c-43f3-abfe-c93967bd85b2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1318 microversion: 2.1 time: 0.190112 May 09 04:33:47.152743 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 501/1020] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:46 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:47.221264 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-39ace1b1-ce5b-4811-bc12-e6e272793a25 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:47.221748 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-39ace1b1-ce5b-4811-bc12-e6e272793a25 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:47.228107 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-39ace1b1-ce5b-4811-bc12-e6e272793a25 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:47.228564 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-39ace1b1-ce5b-4811-bc12-e6e272793a25 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:47.229325 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-39ace1b1-ce5b-4811-bc12-e6e272793a25 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:47.229762 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-39ace1b1-ce5b-4811-bc12-e6e272793a25 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:47.244558 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-39ace1b1-ce5b-4811-bc12-e6e272793a25 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] HTTP exception thrown: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-39ace1b1-ce5b-4811-bc12-e6e272793a25 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Request method failure captured: May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: DELETE /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 HTTP/1.1 May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJhTbCVgTT3HZuxvtZpJ_cLiO-p5aO5ZCrkaJhYtCXNfzo_IXS3499vPTrl-cgrMt-SnaVL5V4wtRTXaaPRZskqvbSNvwlk-mrGJOcozoTU2E5zQ45dYOd-AEzlNKKX4qka08Rdzwq7NFgcZCZDko0TOyv7hyBbf4It5Ltr84wDaqIk May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:33:47.246116 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:33:47.247675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:47.247675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:47.247675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:47.247675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:47.247675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:47.247675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:33:47.247675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:33:47.247675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: c56a403eeee84720ba765e2d4367df74 May 09 04:33:47.247675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:47.247675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:33:47.247675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:33:47.247675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': '48735dde-9de8-4b71-877f-e86789f4c887'} May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:47.248957 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:33:47.250581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:33:47.252067 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-39ace1b1-ce5b-4811-bc12-e6e272793a25 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Returning 404 to user: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:47.252067 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-39ace1b1-ce5b-4811-bc12-e6e272793a25 tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "DELETE /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 404 len: 111 microversion: 2.1 time: 0.030098 May 09 04:33:47.252067 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 520/1021] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:33:47 2022] DELETE /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:33:47.256460 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-16673c4b-6c7d-459d-bc7f-e453c4aeea4d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:47.257132 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-16673c4b-6c7d-459d-bc7f-e453c4aeea4d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] [instance: 48735dde-9de8-4b71-877f-e86789f4c887] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:47.263843 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-16673c4b-6c7d-459d-bc7f-e453c4aeea4d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:47.264676 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-16673c4b-6c7d-459d-bc7f-e453c4aeea4d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:47.265098 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-16673c4b-6c7d-459d-bc7f-e453c4aeea4d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:47.265535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-16673c4b-6c7d-459d-bc7f-e453c4aeea4d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:47.281366 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-16673c4b-6c7d-459d-bc7f-e453c4aeea4d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] HTTP exception thrown: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-16673c4b-6c7d-459d-bc7f-e453c4aeea4d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Request method failure captured: May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 HTTP/1.1 May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJhTbCVgTT3HZuxvtZpJ_cLiO-p5aO5ZCrkaJhYtCXNfzo_IXS3499vPTrl-cgrMt-SnaVL5V4wtRTXaaPRZskqvbSNvwlk-mrGJOcozoTU2E5zQ45dYOd-AEzlNKKX4qka08Rdzwq7NFgcZCZDko0TOyv7hyBbf4It5Ltr84wDaqIk May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:33:47.282966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:33:47.284390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9c83b0a8b88f452f9e12d077e8ac28c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:33:47.284390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:47.284390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 9c83b0a8b88f452f9e12d077e8ac28c8 May 09 04:33:47.284390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-70527954 May 09 04:33:47.284390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:47.284390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:33:47.284390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:33:47.284390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: c56a403eeee84720ba765e2d4367df74 May 09 04:33:47.284390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-AttachVolumeNegativeTest-70527954-project May 09 04:33:47.284390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:33:47.284390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:33:47.284390 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '48735dde-9de8-4b71-877f-e86789f4c887'} May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:33:47.285145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. May 09 04:33:47.286350 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:33:47.287450 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-16673c4b-6c7d-459d-bc7f-e453c4aeea4d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] Returning 404 to user: Instance 48735dde-9de8-4b71-877f-e86789f4c887 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:33:47.287450 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-16673c4b-6c7d-459d-bc7f-e453c4aeea4d tempest-AttachVolumeNegativeTest-70527954 tempest-AttachVolumeNegativeTest-70527954-project] 10.222.0.44 "GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887" status: 404 len: 111 microversion: 2.1 time: 0.031750 May 09 04:33:47.288466 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 502/1022] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:47 2022] GET /compute/v2.1/servers/48735dde-9de8-4b71-877f-e86789f4c887 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:33:48.172050 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-183ee3c2-13b0-4a28-98bf-d9afa3d1ab39 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:48.172737 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-183ee3c2-13b0-4a28-98bf-d9afa3d1ab39 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:48.179606 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-183ee3c2-13b0-4a28-98bf-d9afa3d1ab39 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:48.180113 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-183ee3c2-13b0-4a28-98bf-d9afa3d1ab39 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:48.180897 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-183ee3c2-13b0-4a28-98bf-d9afa3d1ab39 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:48.181336 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-183ee3c2-13b0-4a28-98bf-d9afa3d1ab39 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:48.318554 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-183ee3c2-13b0-4a28-98bf-d9afa3d1ab39 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:48.330173 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-183ee3c2-13b0-4a28-98bf-d9afa3d1ab39 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1506 microversion: 2.1 time: 0.164197 May 09 04:33:48.330688 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 521/1023] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:48 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:53.947378 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-556237162", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-901938689", "security_groups": [{"name": "tempest-secgroup-smoke-1544934256"}], "block_device_mapping_v2": [{"uuid": "c970dddc-683e-4a8b-95de-9aea9c5ba1db", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d0b894fb-ca2e-4f02-9d2e-0b887784e9ae"}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:54.091852 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] validate_networks() for [('d0b894fb-ca2e-4f02-9d2e-0b887784e9ae', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:33:54.725856 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:33:54.726511 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:33:54.729746 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:33:54.730241 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:33:54.730742 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:33:54.758078 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:54.758919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:54.765436 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:54.765894 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:54.785409 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Getting quotas for project b6223852af9c4361b99a24e7a49a7734. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:33:54.789465 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Getting quotas for user cb34feb512764ec5b9ca25c30c3d7159 and project b6223852af9c4361b99a24e7a49a7734. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:33:54.812130 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-23017c81-abca-41e4-a773-008b8fbe9b24 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] Calling method '.version_select at 0x7fbfd44dc9d0>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:54.858263 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:33:54.860900 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c970dddc-683e-4a8b-95de-9aea9c5ba1db',volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:33:54.868803 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-23017c81-abca-41e4-a773-008b8fbe9b24 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/adecc25c-2d91-4cb7-ac3d-09fa5ed95e89" status: 200 len: 351 microversion: 2.1 time: 0.062030 May 09 04:33:54.869902 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 522/1024] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 04:33:54 2022] GET /compute/v2.1/os-volumes/adecc25c-2d91-4cb7-ac3d-09fa5ed95e89 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:33:55.084145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-af2a3cf8-b43e-43e4-b9df-194ef0544a63 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.140752 May 09 04:33:55.084800 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 503/1025] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:33:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 09 04:33:55.097034 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-51d76ef9-5e47-4fe7-85bf-aa3d2835e7b8 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:55.097782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-51d76ef9-5e47-4fe7-85bf-aa3d2835e7b8 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:55.227649 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-51d76ef9-5e47-4fe7-85bf-aa3d2835e7b8 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:55.237636 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-51d76ef9-5e47-4fe7-85bf-aa3d2835e7b8 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1093 microversion: 2.1 time: 0.145362 May 09 04:33:55.238205 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 523/1026] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:55 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1093 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:56.255650 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-adc634ed-4f53-45df-9df5-c4d727df3a1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:56.256314 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-adc634ed-4f53-45df-9df5-c4d727df3a1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:56.265796 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-adc634ed-4f53-45df-9df5-c4d727df3a1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:56.266145 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-adc634ed-4f53-45df-9df5-c4d727df3a1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:56.266924 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-adc634ed-4f53-45df-9df5-c4d727df3a1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:56.272256 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-adc634ed-4f53-45df-9df5-c4d727df3a1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:56.379267 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-61c7cfa2-0559-4c5b-8e02-2adb5cedf1c7 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] Calling method '.version_select at 0x7fbfd96de280>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:56.402201 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-adc634ed-4f53-45df-9df5-c4d727df3a1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:56.416464 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-adc634ed-4f53-45df-9df5-c4d727df3a1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1209 microversion: 2.1 time: 0.165334 May 09 04:33:56.425965 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 504/1027] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:56 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1209 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:56.531108 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-61c7cfa2-0559-4c5b-8e02-2adb5cedf1c7 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/597e1016-7997-41d5-8708-8a5d3a338f67" status: 200 len: 350 microversion: 2.1 time: 0.180608 May 09 04:33:56.531683 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 524/1028] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 04:33:56 2022] GET /compute/v2.1/os-volumes/597e1016-7997-41d5-8708-8a5d3a338f67 => generated 350 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:33:57.434536 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9c376e87-670d-4be1-80fa-d592ef476e7c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:57.435903 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9c376e87-670d-4be1-80fa-d592ef476e7c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:57.443013 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c376e87-670d-4be1-80fa-d592ef476e7c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:57.443545 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c376e87-670d-4be1-80fa-d592ef476e7c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:57.444576 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c376e87-670d-4be1-80fa-d592ef476e7c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:57.448299 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c376e87-670d-4be1-80fa-d592ef476e7c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:57.721594 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9c376e87-670d-4be1-80fa-d592ef476e7c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:57.753395 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9c376e87-670d-4be1-80fa-d592ef476e7c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1277 microversion: 2.1 time: 0.323159 May 09 04:33:57.766058 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 505/1029] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:57 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1277 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:57.828256 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-36787642", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "networks": [{"uuid": "10ea8df3-f6d6-4d02-b7d8-5d5975ce3e16"}]}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:57.938867 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-a2e5764e-bd8b-4766-8676-46d68b842b1f req-4a91a38a-de55-4326-a1c1-c73278180cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dcd6d81-e095-4cc4-9c05-276e02d3f1dc", "tag": "955434ea-3868-4ce0-a79f-ebf7e2af37c0"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:33:57.951212 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-a2e5764e-bd8b-4766-8676-46d68b842b1f req-4a91a38a-de55-4326-a1c1-c73278180cb3 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:57.951510 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-a2e5764e-bd8b-4766-8676-46d68b842b1f req-4a91a38a-de55-4326-a1c1-c73278180cb3 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:57.974749 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-a2e5764e-bd8b-4766-8676-46d68b842b1f req-4a91a38a-de55-4326-a1c1-c73278180cb3 service nova] Creating event network-changed:955434ea-3868-4ce0-a79f-ebf7e2af37c0 for instance 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc on hv-cinder-83800 May 09 04:33:57.981336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-a2e5764e-bd8b-4766-8676-46d68b842b1f req-4a91a38a-de55-4326-a1c1-c73278180cb3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049024 May 09 04:33:57.982952 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 506/1030] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:33:57.996340 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-063f0875-9d41-4a70-9ffa-c932e7771114 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] Calling method '.version_select at 0x7fbfd460f3a0>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:58.053469 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-063f0875-9d41-4a70-9ffa-c932e7771114 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/f8bccf1e-cb58-4575-a8e4-82de358c8b2b" status: 200 len: 350 microversion: 2.1 time: 0.061591 May 09 04:33:58.054311 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 507/1031] 10.222.0.44 () {58 vars in 1244 bytes} [Mon May 9 04:33:57 2022] GET /compute/v2.1/os-volumes/f8bccf1e-cb58-4575-a8e4-82de358c8b2b => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:33:58.065666 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-119d2573-0f3f-4f12-a437-3580a9066447 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] Calling method '.version_select at 0x7fbfd44bd4c0>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:58.154563 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-119d2573-0f3f-4f12-a437-3580a9066447 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092264 May 09 04:33:58.155269 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 508/1032] 10.222.0.44 () {58 vars in 1133 bytes} [Mon May 9 04:33:58 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:33:58.166730 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9644365b-ff26-4e25-9776-9f203f957a0a tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] Calling method '.version_select at 0x7fbfd4444940>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:58.253089 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9644365b-ff26-4e25-9776-9f203f957a0a tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.089949 May 09 04:33:58.256671 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 509/1033] 10.222.0.44 () {58 vars in 1148 bytes} [Mon May 9 04:33:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:33:58.266110 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-388b075c-8f90-4232-9793-722f7b850c41 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] Calling method '.version_select at 0x7fbfd4444820>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:58.347099 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-388b075c-8f90-4232-9793-722f7b850c41 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085384 May 09 04:33:58.347804 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 510/1034] 10.222.0.44 () {58 vars in 1133 bytes} [Mon May 9 04:33:58 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:33:58.358837 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6e465419-ad50-4ef7-a1b3-d6309f5f0fc1 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] Calling method '.version_select at 0x7fbfd4971160>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:58.445835 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6e465419-ad50-4ef7-a1b3-d6309f5f0fc1 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090872 May 09 04:33:58.446416 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 511/1035] 10.222.0.44 () {58 vars in 1166 bytes} [Mon May 9 04:33:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:33:58.458910 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-708f6d76-d1c3-4875-9577-61d6ba232502 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] Calling method '.version_select at 0x7fbfd44aba60>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:58.539041 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-708f6d76-d1c3-4875-9577-61d6ba232502 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084366 May 09 04:33:58.539615 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 512/1036] 10.222.0.44 () {58 vars in 1169 bytes} [Mon May 9 04:33:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:33:58.550935 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a639d604-c752-4074-8b66-dfb2678b55f0 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] Calling method '.version_select at 0x7fbfd9761670>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:58.635319 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a639d604-c752-4074-8b66-dfb2678b55f0 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087886 May 09 04:33:58.636051 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 513/1037] 10.222.0.44 () {58 vars in 1154 bytes} [Mon May 9 04:33:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:33:58.646619 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0118193d-665b-490a-be87-e2d912759333 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] Calling method '.version_select at 0x7fbfd460ff70>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:58.729321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0118193d-665b-490a-be87-e2d912759333 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086196 May 09 04:33:58.729897 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 514/1038] 10.222.0.44 () {58 vars in 1187 bytes} [Mon May 9 04:33:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:33:58.742214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f19d31f3-9a98-4432-9fec-6ff8dbb091b2 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] Calling method '.version_select at 0x7fbfd4444c10>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:58.823361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f19d31f3-9a98-4432-9fec-6ff8dbb091b2 tempest-VolumesTestJSON-252868450 tempest-VolumesTestJSON-252868450-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084956 May 09 04:33:58.823967 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 515/1039] 10.222.0.44 () {58 vars in 1154 bytes} [Mon May 9 04:33:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:33:58.829415 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c17bb617-7c25-4203-83be-7bea5a74bfba tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:33:58.830336 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c17bb617-7c25-4203-83be-7bea5a74bfba tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:33:58.836959 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c17bb617-7c25-4203-83be-7bea5a74bfba tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:58.837406 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c17bb617-7c25-4203-83be-7bea5a74bfba tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:58.838812 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c17bb617-7c25-4203-83be-7bea5a74bfba tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:33:58.839699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c17bb617-7c25-4203-83be-7bea5a74bfba tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:33:59.060583 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c17bb617-7c25-4203-83be-7bea5a74bfba tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:33:59.067909 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c17bb617-7c25-4203-83be-7bea5a74bfba tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1265 microversion: 2.1 time: 0.242804 May 09 04:33:59.068535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 516/1040] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:33:58 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:00.084766 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8eb0f2ab-7ec8-43c5-b5f4-30e830452316 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:00.085405 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8eb0f2ab-7ec8-43c5-b5f4-30e830452316 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:00.092988 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8eb0f2ab-7ec8-43c5-b5f4-30e830452316 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:00.093447 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8eb0f2ab-7ec8-43c5-b5f4-30e830452316 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:00.094224 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8eb0f2ab-7ec8-43c5-b5f4-30e830452316 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:00.094672 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8eb0f2ab-7ec8-43c5-b5f4-30e830452316 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:00.226388 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8eb0f2ab-7ec8-43c5-b5f4-30e830452316 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:00.235527 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8eb0f2ab-7ec8-43c5-b5f4-30e830452316 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1265 microversion: 2.1 time: 0.154612 May 09 04:34:00.236165 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 517/1041] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:00 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:34:01.253438 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a40e9e8c-2e34-4fa4-9e5a-8dfec5a736d7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:01.254101 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a40e9e8c-2e34-4fa4-9e5a-8dfec5a736d7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:01.260553 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a40e9e8c-2e34-4fa4-9e5a-8dfec5a736d7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:01.260998 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a40e9e8c-2e34-4fa4-9e5a-8dfec5a736d7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:01.261769 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a40e9e8c-2e34-4fa4-9e5a-8dfec5a736d7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:01.262202 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a40e9e8c-2e34-4fa4-9e5a-8dfec5a736d7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:01.396121 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a40e9e8c-2e34-4fa4-9e5a-8dfec5a736d7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:01.404464 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a40e9e8c-2e34-4fa4-9e5a-8dfec5a736d7 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1265 microversion: 2.1 time: 0.155788 May 09 04:34:01.417047 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 518/1042] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:01 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:34:02.424693 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-578896e8-b35c-4022-a998-f507027d1fd0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:02.425531 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-578896e8-b35c-4022-a998-f507027d1fd0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:02.432413 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-578896e8-b35c-4022-a998-f507027d1fd0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:02.432862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-578896e8-b35c-4022-a998-f507027d1fd0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:02.433810 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-578896e8-b35c-4022-a998-f507027d1fd0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:02.434253 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-578896e8-b35c-4022-a998-f507027d1fd0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:02.583797 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-578896e8-b35c-4022-a998-f507027d1fd0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:02.592047 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-578896e8-b35c-4022-a998-f507027d1fd0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1265 microversion: 2.1 time: 0.171211 May 09 04:34:02.594101 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 519/1043] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:02 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:34:03.417826 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.network.neutron [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] validate_networks() for [('10ea8df3-f6d6-4d02-b7d8-5d5975ce3e16', None, None, None, None, None)] {{(pid=117033) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:34:03.610852 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a80e1b21-8ba9-4cc7-a0b6-9b5f29f02e42 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:03.612116 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a80e1b21-8ba9-4cc7-a0b6-9b5f29f02e42 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:03.618464 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a80e1b21-8ba9-4cc7-a0b6-9b5f29f02e42 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:03.618913 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a80e1b21-8ba9-4cc7-a0b6-9b5f29f02e42 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:03.619676 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a80e1b21-8ba9-4cc7-a0b6-9b5f29f02e42 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:03.620253 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a80e1b21-8ba9-4cc7-a0b6-9b5f29f02e42 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:03.782535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a80e1b21-8ba9-4cc7-a0b6-9b5f29f02e42 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:03.793879 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a80e1b21-8ba9-4cc7-a0b6-9b5f29f02e42 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1265 microversion: 2.1 time: 0.187295 May 09 04:34:03.794667 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 520/1044] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:03 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:34:03.829669 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Flavor limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:34:03.830206 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Image limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:34:03.831000 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Flavor pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:34:03.831509 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Image pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:34:03.832022 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:34:03.843583 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:03.844079 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:03.845053 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:03.845739 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:03.866958 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Getting quotas for project 20b03a05541e4ee38dc5f94a6e4bdc69. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:34:03.871829 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Getting quotas for user 09dd259fed464b8c98749dd7e369e871 and project 20b03a05541e4ee38dc5f94a6e4bdc69. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:34:03.883728 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Going to run 1 instances... {{(pid=117033) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:34:03.886060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:34:03.937280 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-718ab41d-7770-4b61-bd22-6995f09c419b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.114406 May 09 04:34:03.937929 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 525/1045] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:33:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 6116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 09 04:34:03.948270 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a3b76350-0587-4bff-b27b-1d4ee147e433 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:03.948991 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a3b76350-0587-4bff-b27b-1d4ee147e433 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:04.025714 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a3b76350-0587-4bff-b27b-1d4ee147e433 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:04.034038 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a3b76350-0587-4bff-b27b-1d4ee147e433 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1212 microversion: 2.1 time: 0.089465 May 09 04:34:04.035261 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 521/1046] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:03 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1212 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:04.810734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-05b3f58e-5dfc-4c16-a950-6bf617211a41 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:04.812393 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-05b3f58e-5dfc-4c16-a950-6bf617211a41 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:04.818302 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05b3f58e-5dfc-4c16-a950-6bf617211a41 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:04.818752 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05b3f58e-5dfc-4c16-a950-6bf617211a41 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:04.819516 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05b3f58e-5dfc-4c16-a950-6bf617211a41 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:04.819973 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-05b3f58e-5dfc-4c16-a950-6bf617211a41 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:04.985894 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-05b3f58e-5dfc-4c16-a950-6bf617211a41 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:04.993358 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-05b3f58e-5dfc-4c16-a950-6bf617211a41 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1265 microversion: 2.1 time: 0.186701 May 09 04:34:04.994663 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 526/1047] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:04 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:05.051619 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b6045ed5-b3ba-4e14-87d1-0b98cf75eb05 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:05.052965 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b6045ed5-b3ba-4e14-87d1-0b98cf75eb05 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:05.064707 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b6045ed5-b3ba-4e14-87d1-0b98cf75eb05 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:05.066048 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b6045ed5-b3ba-4e14-87d1-0b98cf75eb05 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:05.067767 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b6045ed5-b3ba-4e14-87d1-0b98cf75eb05 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:05.068753 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b6045ed5-b3ba-4e14-87d1-0b98cf75eb05 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:05.156167 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b6045ed5-b3ba-4e14-87d1-0b98cf75eb05 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:05.163947 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b6045ed5-b3ba-4e14-87d1-0b98cf75eb05 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1282 microversion: 2.1 time: 0.116387 May 09 04:34:05.165194 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 522/1048] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:05 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1282 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:34:06.010904 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-574c6b4c-23fd-4d6f-984e-ff26ce72a953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:06.011522 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-574c6b4c-23fd-4d6f-984e-ff26ce72a953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:06.018667 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-574c6b4c-23fd-4d6f-984e-ff26ce72a953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:06.019109 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-574c6b4c-23fd-4d6f-984e-ff26ce72a953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:06.019876 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-574c6b4c-23fd-4d6f-984e-ff26ce72a953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:06.020346 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-574c6b4c-23fd-4d6f-984e-ff26ce72a953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:06.183111 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-65b6cbf6-fb6c-49ec-aa84-4324f81513f3 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:06.184340 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-65b6cbf6-fb6c-49ec-aa84-4324f81513f3 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:06.185694 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-574c6b4c-23fd-4d6f-984e-ff26ce72a953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:06.193511 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-574c6b4c-23fd-4d6f-984e-ff26ce72a953 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1265 microversion: 2.1 time: 0.186380 May 09 04:34:06.193856 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-65b6cbf6-fb6c-49ec-aa84-4324f81513f3 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:06.194306 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-65b6cbf6-fb6c-49ec-aa84-4324f81513f3 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:06.195076 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-65b6cbf6-fb6c-49ec-aa84-4324f81513f3 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:06.195607 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-65b6cbf6-fb6c-49ec-aa84-4324f81513f3 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:06.204551 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 527/1049] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:06 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:06.422375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-65b6cbf6-fb6c-49ec-aa84-4324f81513f3 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:06.432701 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-65b6cbf6-fb6c-49ec-aa84-4324f81513f3 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1312 microversion: 2.1 time: 0.253962 May 09 04:34:06.433283 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 523/1050] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:06 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1312 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:06.536378 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-66a3635a-a4e8-4fea-9c1d-4a6c931330f5 req-257c8555-3c68-4ae0-bc5d-ec511eb1babe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c4c812-254e-448e-91f3-58588d0e714f", "tag": "d8927a25-6b46-4f7f-97dd-a07988a6520e"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:34:06.546383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-66a3635a-a4e8-4fea-9c1d-4a6c931330f5 req-257c8555-3c68-4ae0-bc5d-ec511eb1babe service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:06.547458 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-66a3635a-a4e8-4fea-9c1d-4a6c931330f5 req-257c8555-3c68-4ae0-bc5d-ec511eb1babe service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:06.561463 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-66a3635a-a4e8-4fea-9c1d-4a6c931330f5 req-257c8555-3c68-4ae0-bc5d-ec511eb1babe service nova] Creating event network-changed:d8927a25-6b46-4f7f-97dd-a07988a6520e for instance 27c4c812-254e-448e-91f3-58588d0e714f on hv-cinder-83800 May 09 04:34:06.566558 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-66a3635a-a4e8-4fea-9c1d-4a6c931330f5 req-257c8555-3c68-4ae0-bc5d-ec511eb1babe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034282 May 09 04:34:06.567435 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 528/1051] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:34:07.211348 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d3d01b8a-53e2-4ccc-9b97-43b4b32fdf1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:07.212124 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d3d01b8a-53e2-4ccc-9b97-43b4b32fdf1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:07.219227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d3d01b8a-53e2-4ccc-9b97-43b4b32fdf1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:07.219814 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d3d01b8a-53e2-4ccc-9b97-43b4b32fdf1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:07.220864 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d3d01b8a-53e2-4ccc-9b97-43b4b32fdf1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:07.221615 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d3d01b8a-53e2-4ccc-9b97-43b4b32fdf1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:07.361499 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d3d01b8a-53e2-4ccc-9b97-43b4b32fdf1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:07.368931 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d3d01b8a-53e2-4ccc-9b97-43b4b32fdf1e tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1265 microversion: 2.1 time: 0.161556 May 09 04:34:07.369810 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 524/1052] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:07 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:07.449898 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-869c10c5-5a1b-4557-b97f-93bf114ae5ad tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:07.450714 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-869c10c5-5a1b-4557-b97f-93bf114ae5ad tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:07.457912 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-869c10c5-5a1b-4557-b97f-93bf114ae5ad tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:07.458358 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-869c10c5-5a1b-4557-b97f-93bf114ae5ad tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:07.459120 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-869c10c5-5a1b-4557-b97f-93bf114ae5ad tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:07.459553 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-869c10c5-5a1b-4557-b97f-93bf114ae5ad tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:07.604533 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-869c10c5-5a1b-4557-b97f-93bf114ae5ad tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:07.613542 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-869c10c5-5a1b-4557-b97f-93bf114ae5ad tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1312 microversion: 2.1 time: 0.167666 May 09 04:34:07.614125 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 529/1053] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:07 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:08.396094 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6c948945-b4d7-424b-a523-f5316baf25e4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:08.396094 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6c948945-b4d7-424b-a523-f5316baf25e4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:08.397183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c948945-b4d7-424b-a523-f5316baf25e4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:08.398176 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c948945-b4d7-424b-a523-f5316baf25e4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:08.398960 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c948945-b4d7-424b-a523-f5316baf25e4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:08.399391 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c948945-b4d7-424b-a523-f5316baf25e4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:08.563837 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6c948945-b4d7-424b-a523-f5316baf25e4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:08.571365 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6c948945-b4d7-424b-a523-f5316baf25e4 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1265 microversion: 2.1 time: 0.188735 May 09 04:34:08.572068 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 525/1054] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:08 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:08.630659 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-9a049d91-5fb9-475c-a11d-b9167388f61c tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:08.631288 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-9a049d91-5fb9-475c-a11d-b9167388f61c tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:08.637670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9a049d91-5fb9-475c-a11d-b9167388f61c tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:08.638123 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9a049d91-5fb9-475c-a11d-b9167388f61c tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:08.638971 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9a049d91-5fb9-475c-a11d-b9167388f61c tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:08.639691 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9a049d91-5fb9-475c-a11d-b9167388f61c tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:08.798972 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9a049d91-5fb9-475c-a11d-b9167388f61c tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:08.806382 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-9a049d91-5fb9-475c-a11d-b9167388f61c tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1312 microversion: 2.1 time: 0.179604 May 09 04:34:08.807486 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 530/1055] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:08 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1312 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:09.183647 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7947f755-4407-49e3-8a12-72bcbf6052e5 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "430a53dc-123d-404e-bec3-a5b4a2e4a096", "device": "/dev/sdb"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:34:09.185308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7947f755-4407-49e3-8a12-72bcbf6052e5 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:09.191428 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7947f755-4407-49e3-8a12-72bcbf6052e5 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:09.191876 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7947f755-4407-49e3-8a12-72bcbf6052e5 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:09.192677 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7947f755-4407-49e3-8a12-72bcbf6052e5 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:09.193109 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7947f755-4407-49e3-8a12-72bcbf6052e5 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:09.438469 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7947f755-4407-49e3-8a12-72bcbf6052e5 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "POST /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258603 May 09 04:34:09.439125 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 526/1056] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 04:34:09 2022] POST /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:34:09.588314 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4f5c593d-1e0f-4b3d-be1c-d2c726ca2d44 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:09.589637 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-4f5c593d-1e0f-4b3d-be1c-d2c726ca2d44 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:09.597852 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4f5c593d-1e0f-4b3d-be1c-d2c726ca2d44 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:09.598488 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4f5c593d-1e0f-4b3d-be1c-d2c726ca2d44 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:09.599349 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4f5c593d-1e0f-4b3d-be1c-d2c726ca2d44 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:09.600138 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4f5c593d-1e0f-4b3d-be1c-d2c726ca2d44 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:09.736656 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-f16ee5a6-1909-4554-b3d6-f907e9d441ad req-1da6aa11-121c-4879-8af2-ca4139de13ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dcd6d81-e095-4cc4-9c05-276e02d3f1dc", "name": "network-vif-plugged", "status": "completed", "tag": "955434ea-3868-4ce0-a79f-ebf7e2af37c0"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:34:09.746066 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-f16ee5a6-1909-4554-b3d6-f907e9d441ad req-1da6aa11-121c-4879-8af2-ca4139de13ed service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:09.746919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-f16ee5a6-1909-4554-b3d6-f907e9d441ad req-1da6aa11-121c-4879-8af2-ca4139de13ed service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:09.766407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4f5c593d-1e0f-4b3d-be1c-d2c726ca2d44 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:09.770245 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-f16ee5a6-1909-4554-b3d6-f907e9d441ad req-1da6aa11-121c-4879-8af2-ca4139de13ed service nova] Creating event network-vif-plugged:955434ea-3868-4ce0-a79f-ebf7e2af37c0 for instance 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc on hv-cinder-83800 May 09 04:34:09.775448 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-4f5c593d-1e0f-4b3d-be1c-d2c726ca2d44 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1265 microversion: 2.1 time: 0.191017 May 09 04:34:09.775621 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-f16ee5a6-1909-4554-b3d6-f907e9d441ad req-1da6aa11-121c-4879-8af2-ca4139de13ed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044489 May 09 04:34:09.776415 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 531/1058] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:09 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:09.776566 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 527/1058] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 04:34:09.823373 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-9eff8bb5-6324-4ae5-89d9-a842f5180d94 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:09.824012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-9eff8bb5-6324-4ae5-89d9-a842f5180d94 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:09.830544 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9eff8bb5-6324-4ae5-89d9-a842f5180d94 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:09.830992 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9eff8bb5-6324-4ae5-89d9-a842f5180d94 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:09.831752 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9eff8bb5-6324-4ae5-89d9-a842f5180d94 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:09.832216 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9eff8bb5-6324-4ae5-89d9-a842f5180d94 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:09.972901 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9eff8bb5-6324-4ae5-89d9-a842f5180d94 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:09.980548 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-9eff8bb5-6324-4ae5-89d9-a842f5180d94 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1312 microversion: 2.1 time: 0.161015 May 09 04:34:09.981112 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 532/1059] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:09 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:10.793441 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a9706c10-ecbf-4a55-8b38-a870d2b35683 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:10.794278 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a9706c10-ecbf-4a55-8b38-a870d2b35683 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:10.800290 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9706c10-ecbf-4a55-8b38-a870d2b35683 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:10.800734 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9706c10-ecbf-4a55-8b38-a870d2b35683 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:10.801490 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9706c10-ecbf-4a55-8b38-a870d2b35683 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:10.801918 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9706c10-ecbf-4a55-8b38-a870d2b35683 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:10.939925 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a9706c10-ecbf-4a55-8b38-a870d2b35683 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:10.947393 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a9706c10-ecbf-4a55-8b38-a870d2b35683 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1265 microversion: 2.1 time: 0.159124 May 09 04:34:10.955284 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 528/1060] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:10 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:10.998002 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-23ad3f42-1d23-40a8-844d-1f0e53f811b4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:10.999444 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-23ad3f42-1d23-40a8-844d-1f0e53f811b4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:11.005912 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-23ad3f42-1d23-40a8-844d-1f0e53f811b4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:11.006365 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-23ad3f42-1d23-40a8-844d-1f0e53f811b4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:11.007137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-23ad3f42-1d23-40a8-844d-1f0e53f811b4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:11.007625 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-23ad3f42-1d23-40a8-844d-1f0e53f811b4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:11.152397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-23ad3f42-1d23-40a8-844d-1f0e53f811b4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:11.159701 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-23ad3f42-1d23-40a8-844d-1f0e53f811b4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1312 microversion: 2.1 time: 0.165564 May 09 04:34:11.160294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 533/1061] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:10 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:11.966081 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0c21a021-1fb6-4bb1-8745-cb4ed5dcb6ae tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:11.966713 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0c21a021-1fb6-4bb1-8745-cb4ed5dcb6ae tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:11.973751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c21a021-1fb6-4bb1-8745-cb4ed5dcb6ae tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:11.974200 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c21a021-1fb6-4bb1-8745-cb4ed5dcb6ae tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:11.974966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c21a021-1fb6-4bb1-8745-cb4ed5dcb6ae tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:11.975398 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c21a021-1fb6-4bb1-8745-cb4ed5dcb6ae tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:12.116403 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0c21a021-1fb6-4bb1-8745-cb4ed5dcb6ae tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:12.124181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0c21a021-1fb6-4bb1-8745-cb4ed5dcb6ae tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1452 microversion: 2.1 time: 0.162168 May 09 04:34:12.125156 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 529/1062] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:11 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:34:12.142131 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-297a1d71-37c4-40ac-98b0-6f9993ff90d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:12.142731 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-297a1d71-37c4-40ac-98b0-6f9993ff90d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:12.149010 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-297a1d71-37c4-40ac-98b0-6f9993ff90d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:12.149473 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-297a1d71-37c4-40ac-98b0-6f9993ff90d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:12.150254 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-297a1d71-37c4-40ac-98b0-6f9993ff90d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:12.150693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-297a1d71-37c4-40ac-98b0-6f9993ff90d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:12.177139 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9a7137d9-e76e-4402-b0a5-e73f0e2f3aa4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:12.177858 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9a7137d9-e76e-4402-b0a5-e73f0e2f3aa4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:12.184337 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9a7137d9-e76e-4402-b0a5-e73f0e2f3aa4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:12.184870 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9a7137d9-e76e-4402-b0a5-e73f0e2f3aa4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:12.186080 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9a7137d9-e76e-4402-b0a5-e73f0e2f3aa4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:12.186518 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9a7137d9-e76e-4402-b0a5-e73f0e2f3aa4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:12.315148 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-297a1d71-37c4-40ac-98b0-6f9993ff90d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:12.322568 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-297a1d71-37c4-40ac-98b0-6f9993ff90d0 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1452 microversion: 2.1 time: 0.184777 May 09 04:34:12.323201 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 534/1063] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:12 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:12.334266 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9a7137d9-e76e-4402-b0a5-e73f0e2f3aa4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:12.345082 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9a7137d9-e76e-4402-b0a5-e73f0e2f3aa4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1312 microversion: 2.1 time: 0.171959 May 09 04:34:12.345854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 530/1064] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:12 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:13.362106 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-eaf751a8-bb0d-4f44-958b-2677c0288dab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:13.362724 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-eaf751a8-bb0d-4f44-958b-2677c0288dab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:13.369106 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eaf751a8-bb0d-4f44-958b-2677c0288dab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:13.369559 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eaf751a8-bb0d-4f44-958b-2677c0288dab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:13.370327 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eaf751a8-bb0d-4f44-958b-2677c0288dab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:13.370766 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-eaf751a8-bb0d-4f44-958b-2677c0288dab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:13.509305 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-eaf751a8-bb0d-4f44-958b-2677c0288dab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:13.517646 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-eaf751a8-bb0d-4f44-958b-2677c0288dab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1312 microversion: 2.1 time: 0.159397 May 09 04:34:13.518231 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 535/1065] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:13 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:14.125759 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-0b0fc26a-a8ba-4adf-86dd-8f360b448819 req-edccc7e7-56c9-420b-959e-c8f979f04a63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dcd6d81-e095-4cc4-9c05-276e02d3f1dc", "tag": "955434ea-3868-4ce0-a79f-ebf7e2af37c0"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:34:14.133738 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-0b0fc26a-a8ba-4adf-86dd-8f360b448819 req-edccc7e7-56c9-420b-959e-c8f979f04a63 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:14.134307 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-0b0fc26a-a8ba-4adf-86dd-8f360b448819 req-edccc7e7-56c9-420b-959e-c8f979f04a63 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:14.146303 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-0b0fc26a-a8ba-4adf-86dd-8f360b448819 req-edccc7e7-56c9-420b-959e-c8f979f04a63 service nova] Creating event network-changed:955434ea-3868-4ce0-a79f-ebf7e2af37c0 for instance 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc on hv-cinder-83800 May 09 04:34:14.151692 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-0b0fc26a-a8ba-4adf-86dd-8f360b448819 req-edccc7e7-56c9-420b-959e-c8f979f04a63 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032004 May 09 04:34:14.152496 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 531/1066] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:34:14.534971 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-836d21e5-f842-4615-aaf2-748f3c9119d5 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:14.535588 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-836d21e5-f842-4615-aaf2-748f3c9119d5 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:14.541977 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-836d21e5-f842-4615-aaf2-748f3c9119d5 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:14.542453 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-836d21e5-f842-4615-aaf2-748f3c9119d5 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:14.543218 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-836d21e5-f842-4615-aaf2-748f3c9119d5 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:14.543656 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-836d21e5-f842-4615-aaf2-748f3c9119d5 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:14.672203 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-836d21e5-f842-4615-aaf2-748f3c9119d5 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:14.679537 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-836d21e5-f842-4615-aaf2-748f3c9119d5 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1312 microversion: 2.1 time: 0.149011 May 09 04:34:14.680202 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 536/1067] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:14 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:15.698316 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7c53982b-6b6b-46b8-85a5-44c88a8215a4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:15.698930 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7c53982b-6b6b-46b8-85a5-44c88a8215a4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:15.705920 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7c53982b-6b6b-46b8-85a5-44c88a8215a4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:15.706364 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7c53982b-6b6b-46b8-85a5-44c88a8215a4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:15.707147 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7c53982b-6b6b-46b8-85a5-44c88a8215a4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:15.707577 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7c53982b-6b6b-46b8-85a5-44c88a8215a4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:15.928148 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7c53982b-6b6b-46b8-85a5-44c88a8215a4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:15.937694 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7c53982b-6b6b-46b8-85a5-44c88a8215a4 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1312 microversion: 2.1 time: 0.243022 May 09 04:34:15.938988 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 532/1068] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:15 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:16.320048 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-1f23d38a-0a94-4740-924c-327cee945427 req-d260063c-f71e-40e5-a1b4-b0f075107c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c4c812-254e-448e-91f3-58588d0e714f", "name": "network-vif-plugged", "status": "completed", "tag": "d8927a25-6b46-4f7f-97dd-a07988a6520e"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:34:16.334647 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-1f23d38a-0a94-4740-924c-327cee945427 req-d260063c-f71e-40e5-a1b4-b0f075107c68 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:16.335298 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-1f23d38a-0a94-4740-924c-327cee945427 req-d260063c-f71e-40e5-a1b4-b0f075107c68 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:16.353961 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-1f23d38a-0a94-4740-924c-327cee945427 req-d260063c-f71e-40e5-a1b4-b0f075107c68 service nova] Creating event network-vif-plugged:d8927a25-6b46-4f7f-97dd-a07988a6520e for instance 27c4c812-254e-448e-91f3-58588d0e714f on hv-cinder-83800 May 09 04:34:16.360804 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-1f23d38a-0a94-4740-924c-327cee945427 req-d260063c-f71e-40e5-a1b4-b0f075107c68 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048324 May 09 04:34:16.361835 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 537/1069] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:34:16.955701 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d347ca11-220a-4f72-9eb1-7b52f4dd57dd tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:16.956400 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d347ca11-220a-4f72-9eb1-7b52f4dd57dd tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:16.962704 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d347ca11-220a-4f72-9eb1-7b52f4dd57dd tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:16.963166 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d347ca11-220a-4f72-9eb1-7b52f4dd57dd tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:16.963965 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d347ca11-220a-4f72-9eb1-7b52f4dd57dd tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:16.964845 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d347ca11-220a-4f72-9eb1-7b52f4dd57dd tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:17.158891 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d347ca11-220a-4f72-9eb1-7b52f4dd57dd tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:17.166156 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d347ca11-220a-4f72-9eb1-7b52f4dd57dd tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1312 microversion: 2.1 time: 0.215059 May 09 04:34:17.166919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 533/1070] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:16 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1312 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:18.184859 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-3f9d7359-4355-4fb1-b4f1-4f07e5551e53 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:18.185642 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-3f9d7359-4355-4fb1-b4f1-4f07e5551e53 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:18.192551 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3f9d7359-4355-4fb1-b4f1-4f07e5551e53 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:18.193093 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3f9d7359-4355-4fb1-b4f1-4f07e5551e53 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:18.193962 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3f9d7359-4355-4fb1-b4f1-4f07e5551e53 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:18.194495 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-3f9d7359-4355-4fb1-b4f1-4f07e5551e53 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:18.343557 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-3f9d7359-4355-4fb1-b4f1-4f07e5551e53 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:18.351292 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-3f9d7359-4355-4fb1-b4f1-4f07e5551e53 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1312 microversion: 2.1 time: 0.170563 May 09 04:34:18.351856 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 538/1071] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:18 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:19.367978 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ff984cf7-cfd1-4bad-b8d0-a74d641a0ae2 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:19.368602 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ff984cf7-cfd1-4bad-b8d0-a74d641a0ae2 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:19.375051 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff984cf7-cfd1-4bad-b8d0-a74d641a0ae2 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:19.375506 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff984cf7-cfd1-4bad-b8d0-a74d641a0ae2 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:19.376315 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff984cf7-cfd1-4bad-b8d0-a74d641a0ae2 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:19.376751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff984cf7-cfd1-4bad-b8d0-a74d641a0ae2 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:19.508558 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ff984cf7-cfd1-4bad-b8d0-a74d641a0ae2 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:19.516154 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ff984cf7-cfd1-4bad-b8d0-a74d641a0ae2 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1312 microversion: 2.1 time: 0.151948 May 09 04:34:19.516727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 534/1072] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:19 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:20.533112 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b889e0b8-ecb9-4bae-acd8-250b081976db tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:20.533728 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b889e0b8-ecb9-4bae-acd8-250b081976db tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:20.540004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b889e0b8-ecb9-4bae-acd8-250b081976db tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:20.540460 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b889e0b8-ecb9-4bae-acd8-250b081976db tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:20.541237 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b889e0b8-ecb9-4bae-acd8-250b081976db tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:20.541676 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-b889e0b8-ecb9-4bae-acd8-250b081976db tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:20.683120 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b889e0b8-ecb9-4bae-acd8-250b081976db tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:20.693348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b889e0b8-ecb9-4bae-acd8-250b081976db tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1312 microversion: 2.1 time: 0.164217 May 09 04:34:20.693926 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 539/1073] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:20 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:21.712009 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-95798713-6e26-428f-a005-006978e252ba tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:21.713223 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-95798713-6e26-428f-a005-006978e252ba tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:21.721790 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-95798713-6e26-428f-a005-006978e252ba tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:21.722252 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-95798713-6e26-428f-a005-006978e252ba tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:21.723122 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-95798713-6e26-428f-a005-006978e252ba tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:21.723567 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-95798713-6e26-428f-a005-006978e252ba tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:21.916357 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-95798713-6e26-428f-a005-006978e252ba tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:21.930305 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-95798713-6e26-428f-a005-006978e252ba tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1497 microversion: 2.1 time: 0.222948 May 09 04:34:21.930892 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 535/1074] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:21 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1497 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:24.671713 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-038677f5-09ab-436c-b41e-50402c7262bf tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:24.672983 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-038677f5-09ab-436c-b41e-50402c7262bf tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:24.679922 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-038677f5-09ab-436c-b41e-50402c7262bf tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:24.680978 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-038677f5-09ab-436c-b41e-50402c7262bf tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:24.682018 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-038677f5-09ab-436c-b41e-50402c7262bf tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:24.682689 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-038677f5-09ab-436c-b41e-50402c7262bf tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:24.715515 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-038677f5-09ab-436c-b41e-50402c7262bf tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Going to try to terminate instance {{(pid=117033) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:34:24.852622 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-038677f5-09ab-436c-b41e-50402c7262bf tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "DELETE /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 204 len: 0 microversion: 2.1 time: 0.184658 May 09 04:34:24.853258 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 540/1075] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:34:24 2022] DELETE /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:34:24.862441 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-55438504-368b-45f3-bc36-a69ff2a62d5a tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:24.863682 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-55438504-368b-45f3-bc36-a69ff2a62d5a tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:24.877720 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-55438504-368b-45f3-bc36-a69ff2a62d5a tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:24.877720 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-55438504-368b-45f3-bc36-a69ff2a62d5a tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:24.878048 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-55438504-368b-45f3-bc36-a69ff2a62d5a tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:24.878809 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-55438504-368b-45f3-bc36-a69ff2a62d5a tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:25.091094 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-55438504-368b-45f3-bc36-a69ff2a62d5a tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:25.102791 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-55438504-368b-45f3-bc36-a69ff2a62d5a tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1503 microversion: 2.1 time: 0.245247 May 09 04:34:25.103371 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 536/1076] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:24 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1503 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:26.121373 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1f758876-3b5e-4e3b-80a7-28c0df597516 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:26.122082 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1f758876-3b5e-4e3b-80a7-28c0df597516 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:26.128734 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1f758876-3b5e-4e3b-80a7-28c0df597516 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:26.129189 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1f758876-3b5e-4e3b-80a7-28c0df597516 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:26.130048 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1f758876-3b5e-4e3b-80a7-28c0df597516 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:26.130606 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1f758876-3b5e-4e3b-80a7-28c0df597516 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:26.276058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1f758876-3b5e-4e3b-80a7-28c0df597516 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:26.284185 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1f758876-3b5e-4e3b-80a7-28c0df597516 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1503 microversion: 2.1 time: 0.167314 May 09 04:34:26.284762 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 541/1077] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:26 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:34:27.301898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4147f4c8-edb8-4a94-9de7-c47488e4d448 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:27.302463 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4147f4c8-edb8-4a94-9de7-c47488e4d448 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:27.309056 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4147f4c8-edb8-4a94-9de7-c47488e4d448 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:27.309706 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4147f4c8-edb8-4a94-9de7-c47488e4d448 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:27.310634 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4147f4c8-edb8-4a94-9de7-c47488e4d448 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:27.311796 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4147f4c8-edb8-4a94-9de7-c47488e4d448 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:27.367251 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-cdb98e21-1f0f-4f7d-a902-ef74d728d374 req-74f9517e-ccbe-4b32-949c-ba32910ea1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c4c812-254e-448e-91f3-58588d0e714f", "name": "network-vif-deleted", "tag": "d8927a25-6b46-4f7f-97dd-a07988a6520e"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:34:27.378482 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-cdb98e21-1f0f-4f7d-a902-ef74d728d374 req-74f9517e-ccbe-4b32-949c-ba32910ea1f0 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:27.379138 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-cdb98e21-1f0f-4f7d-a902-ef74d728d374 req-74f9517e-ccbe-4b32-949c-ba32910ea1f0 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:27.397282 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-cdb98e21-1f0f-4f7d-a902-ef74d728d374 req-74f9517e-ccbe-4b32-949c-ba32910ea1f0 service nova] Creating event network-vif-deleted:d8927a25-6b46-4f7f-97dd-a07988a6520e for instance 27c4c812-254e-448e-91f3-58588d0e714f on hv-cinder-83800 May 09 04:34:27.403127 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-cdb98e21-1f0f-4f7d-a902-ef74d728d374 req-74f9517e-ccbe-4b32-949c-ba32910ea1f0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043538 May 09 04:34:27.403811 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 542/1078] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:34:27.406753 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4147f4c8-edb8-4a94-9de7-c47488e4d448 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:27.414426 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4147f4c8-edb8-4a94-9de7-c47488e4d448 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 200 len: 1461 microversion: 2.1 time: 0.116413 May 09 04:34:27.415247 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 537/1079] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:27 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 1461 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:28.133146 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-92fbb4f3-035c-439a-8602-f61e6b11a6b1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:28.133732 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-92fbb4f3-035c-439a-8602-f61e6b11a6b1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:28.140228 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-92fbb4f3-035c-439a-8602-f61e6b11a6b1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:28.140710 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-92fbb4f3-035c-439a-8602-f61e6b11a6b1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:28.141517 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-92fbb4f3-035c-439a-8602-f61e6b11a6b1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:28.141911 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-92fbb4f3-035c-439a-8602-f61e6b11a6b1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:28.224484 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.objects.instance [None req-92fbb4f3-035c-439a-8602-f61e6b11a6b1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lazy-loading 'services' on Instance uuid 2c3132a4-8591-418d-8efe-7148c942eb3f {{(pid=117033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:34:28.433654 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-faf6c6c8-8aa5-4eec-bd61-6be40eeb9b26 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:28.434574 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-faf6c6c8-8aa5-4eec-bd61-6be40eeb9b26 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 27c4c812-254e-448e-91f3-58588d0e714f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:28.444797 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-faf6c6c8-8aa5-4eec-bd61-6be40eeb9b26 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:28.445607 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-faf6c6c8-8aa5-4eec-bd61-6be40eeb9b26 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:28.446949 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-faf6c6c8-8aa5-4eec-bd61-6be40eeb9b26 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:28.447695 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-faf6c6c8-8aa5-4eec-bd61-6be40eeb9b26 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:28.476394 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-faf6c6c8-8aa5-4eec-bd61-6be40eeb9b26 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] HTTP exception thrown: Instance 27c4c812-254e-448e-91f3-58588d0e714f could not be found. May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-faf6c6c8-8aa5-4eec-bd61-6be40eeb9b26 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Request method failure captured: May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f HTTP/1.1 May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJmzY_sP4oi_4ixYAq6lj5mK_ktfuCqJFB_MmJKYEIlRIVvg1WAGckzEs-K6up0UpsAcc0KZ9_Ok4LabHAio87udol8wYkHD09OiMYZb-KhQE92STNzgrOOc3xMzZRnLT49BuvOnZan5r7uyj0o8TvDpI_bwgOEVe4woF7v51YmcV0k May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 20b03a05541e4ee38dc5f94a6e4bdc69 May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-VolumesActionsTest-898619899 May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:34:28.478375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:34:28.479727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b03a05541e4ee38dc5f94a6e4bdc69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b03a05541e4ee38dc5f94a6e4bdc69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b03a05541e4ee38dc5f94a6e4bdc69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b03a05541e4ee38dc5f94a6e4bdc69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:34:28.479727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-VolumesActionsTest-898619899 May 09 04:34:28.479727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 20b03a05541e4ee38dc5f94a6e4bdc69 May 09 04:34:28.479727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-VolumesActionsTest-898619899 May 09 04:34:28.479727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-VolumesActionsTest-898619899-project May 09 04:34:28.479727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:34:28.479727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:34:28.479727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 09dd259fed464b8c98749dd7e369e871 May 09 04:34:28.479727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-VolumesActionsTest-898619899-project May 09 04:34:28.479727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:34:28.479727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 27c4c812-254e-448e-91f3-58588d0e714f could not be found. May 09 04:34:28.479727 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '27c4c812-254e-448e-91f3-58588d0e714f'} May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c4c812-254e-448e-91f3-58588d0e714f could not be found. May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:34:28.480535 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c4c812-254e-448e-91f3-58588d0e714f could not be found. May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c4c812-254e-448e-91f3-58588d0e714f could not be found. May 09 04:34:28.482181 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:34:28.484443 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-faf6c6c8-8aa5-4eec-bd61-6be40eeb9b26 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Returning 404 to user: Instance 27c4c812-254e-448e-91f3-58588d0e714f could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:34:28.484443 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-faf6c6c8-8aa5-4eec-bd61-6be40eeb9b26 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f" status: 404 len: 111 microversion: 2.1 time: 0.052694 May 09 04:34:28.484443 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 538/1080] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:28 2022] GET /compute/v2.1/servers/27c4c812-254e-448e-91f3-58588d0e714f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:34:28.535712 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-92fbb4f3-035c-439a-8602-f61e6b11a6b1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f/os-volume_attachments/430a53dc-123d-404e-bec3-a5b4a2e4a096" status: 202 len: 0 microversion: 2.1 time: 0.406961 May 09 04:34:28.537750 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 543/1081] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 04:34:28 2022] DELETE /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f/os-volume_attachments/430a53dc-123d-404e-bec3-a5b4a2e4a096 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:34:28.631127 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2047917378", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "networks": [{"uuid": "10ea8df3-f6d6-4d02-b7d8-5d5975ce3e16"}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:34:28.685546 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] validate_networks() for [('10ea8df3-f6d6-4d02-b7d8-5d5975ce3e16', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:34:29.035782 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:34:29.036223 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:34:29.036740 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:34:29.037167 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:34:29.037571 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:34:29.047347 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:29.047828 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:29.048586 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:29.049013 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:29.080164 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Getting quotas for project 20b03a05541e4ee38dc5f94a6e4bdc69. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:34:29.084479 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Getting quotas for user 09dd259fed464b8c98749dd7e369e871 and project 20b03a05541e4ee38dc5f94a6e4bdc69. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:34:29.097312 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:34:29.100413 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:34:29.146361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-462c879c-b7ff-48ed-bbdf-4b120f911efb tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520127 May 09 04:34:29.146941 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 539/1082] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:34:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 09 04:34:29.158128 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ff8fe417-3321-4944-8cd8-2281af875145 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:29.158834 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ff8fe417-3321-4944-8cd8-2281af875145 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:29.212384 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ff8fe417-3321-4944-8cd8-2281af875145 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:29.220722 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ff8fe417-3321-4944-8cd8-2281af875145 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1214 microversion: 2.1 time: 0.067311 May 09 04:34:29.221701 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 544/1083] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:29 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:29.683830 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b1dd3ccb-7b33-4106-9bf0-dfd99a664f61 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:29.685174 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b1dd3ccb-7b33-4106-9bf0-dfd99a664f61 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:29.696689 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1dd3ccb-7b33-4106-9bf0-dfd99a664f61 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:29.697141 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1dd3ccb-7b33-4106-9bf0-dfd99a664f61 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:29.697932 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1dd3ccb-7b33-4106-9bf0-dfd99a664f61 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:29.698693 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1dd3ccb-7b33-4106-9bf0-dfd99a664f61 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:29.725772 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b1dd3ccb-7b33-4106-9bf0-dfd99a664f61 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:34:29.810712 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b1dd3ccb-7b33-4106-9bf0-dfd99a664f61 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 204 len: 0 microversion: 2.1 time: 0.131326 May 09 04:34:29.811407 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 540/1084] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:34:29 2022] DELETE /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:34:29.821999 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4b592127-43f0-47ce-9c44-289686d0dfe2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:29.823250 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-4b592127-43f0-47ce-9c44-289686d0dfe2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:29.834861 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4b592127-43f0-47ce-9c44-289686d0dfe2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:29.835318 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4b592127-43f0-47ce-9c44-289686d0dfe2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:29.836121 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4b592127-43f0-47ce-9c44-289686d0dfe2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:29.836563 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4b592127-43f0-47ce-9c44-289686d0dfe2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:29.969462 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4b592127-43f0-47ce-9c44-289686d0dfe2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:29.977163 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-4b592127-43f0-47ce-9c44-289686d0dfe2 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1512 microversion: 2.1 time: 0.161227 May 09 04:34:29.977751 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 545/1085] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:29 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:30.238743 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d47e1b7f-06b1-44d2-9f80-06964d68141f tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:30.239414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d47e1b7f-06b1-44d2-9f80-06964d68141f tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:30.245460 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d47e1b7f-06b1-44d2-9f80-06964d68141f tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:30.245908 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d47e1b7f-06b1-44d2-9f80-06964d68141f tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:30.246673 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d47e1b7f-06b1-44d2-9f80-06964d68141f tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:30.247103 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d47e1b7f-06b1-44d2-9f80-06964d68141f tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:30.313169 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d47e1b7f-06b1-44d2-9f80-06964d68141f tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:30.320459 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d47e1b7f-06b1-44d2-9f80-06964d68141f tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1274 microversion: 2.1 time: 0.086298 May 09 04:34:30.321032 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 541/1086] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:30 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:30.994516 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f6f0337b-15be-4199-ba4b-6d654ea928bd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:30.995132 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f6f0337b-15be-4199-ba4b-6d654ea928bd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:31.002026 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f6f0337b-15be-4199-ba4b-6d654ea928bd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:31.002484 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f6f0337b-15be-4199-ba4b-6d654ea928bd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:31.003254 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f6f0337b-15be-4199-ba4b-6d654ea928bd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:31.003693 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f6f0337b-15be-4199-ba4b-6d654ea928bd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:31.143842 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f6f0337b-15be-4199-ba4b-6d654ea928bd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:31.151584 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f6f0337b-15be-4199-ba4b-6d654ea928bd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1512 microversion: 2.1 time: 0.160903 May 09 04:34:31.152188 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 546/1087] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:30 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:31.338258 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dbf8b399-b03b-40c9-b0e0-f8ba12638157 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:31.338875 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dbf8b399-b03b-40c9-b0e0-f8ba12638157 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:31.346154 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dbf8b399-b03b-40c9-b0e0-f8ba12638157 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:31.346601 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dbf8b399-b03b-40c9-b0e0-f8ba12638157 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:31.347361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dbf8b399-b03b-40c9-b0e0-f8ba12638157 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:31.347799 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dbf8b399-b03b-40c9-b0e0-f8ba12638157 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:31.410329 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dbf8b399-b03b-40c9-b0e0-f8ba12638157 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:31.417665 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dbf8b399-b03b-40c9-b0e0-f8ba12638157 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1274 microversion: 2.1 time: 0.083304 May 09 04:34:31.418232 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 542/1088] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:31 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:32.168356 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1af586ed-6de9-4eed-8ef6-c97c1f7a50af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:32.169591 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1af586ed-6de9-4eed-8ef6-c97c1f7a50af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:32.178767 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1af586ed-6de9-4eed-8ef6-c97c1f7a50af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:32.179295 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1af586ed-6de9-4eed-8ef6-c97c1f7a50af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:32.180172 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1af586ed-6de9-4eed-8ef6-c97c1f7a50af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:32.180803 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1af586ed-6de9-4eed-8ef6-c97c1f7a50af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:32.350076 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1af586ed-6de9-4eed-8ef6-c97c1f7a50af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:32.357973 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1af586ed-6de9-4eed-8ef6-c97c1f7a50af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1512 microversion: 2.1 time: 0.193324 May 09 04:34:32.368132 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 547/1089] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:32 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:32.434698 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-47f3f5d9-5b01-4f9c-ba6e-eb07c7b78bf9 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:32.435276 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-47f3f5d9-5b01-4f9c-ba6e-eb07c7b78bf9 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:32.441966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-47f3f5d9-5b01-4f9c-ba6e-eb07c7b78bf9 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:32.442415 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-47f3f5d9-5b01-4f9c-ba6e-eb07c7b78bf9 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:32.443180 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-47f3f5d9-5b01-4f9c-ba6e-eb07c7b78bf9 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:32.443617 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-47f3f5d9-5b01-4f9c-ba6e-eb07c7b78bf9 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:32.705835 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-47f3f5d9-5b01-4f9c-ba6e-eb07c7b78bf9 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:32.713392 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-47f3f5d9-5b01-4f9c-ba6e-eb07c7b78bf9 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1314 microversion: 2.1 time: 0.282507 May 09 04:34:32.714002 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 543/1090] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:32 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:32.824388 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-8d695dfa-2d0b-4c4e-88da-9660bfdb02a7 req-043e9bd4-b800-4fee-a3f4-faaec2a052c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c3132a4-8591-418d-8efe-7148c942eb3f", "name": "network-vif-deleted", "tag": "5c419669-8aea-4b2e-9dd3-40cafa53920b"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:34:32.833212 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-8d695dfa-2d0b-4c4e-88da-9660bfdb02a7 req-043e9bd4-b800-4fee-a3f4-faaec2a052c8 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:32.834537 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-8d695dfa-2d0b-4c4e-88da-9660bfdb02a7 req-043e9bd4-b800-4fee-a3f4-faaec2a052c8 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:32.847301 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-8d695dfa-2d0b-4c4e-88da-9660bfdb02a7 req-043e9bd4-b800-4fee-a3f4-faaec2a052c8 service nova] Creating event network-vif-deleted:5c419669-8aea-4b2e-9dd3-40cafa53920b for instance 2c3132a4-8591-418d-8efe-7148c942eb3f on hv-cinder-83800 May 09 04:34:32.852794 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-8d695dfa-2d0b-4c4e-88da-9660bfdb02a7 req-043e9bd4-b800-4fee-a3f4-faaec2a052c8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031805 May 09 04:34:32.853983 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 548/1091] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:34:33.376836 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6861bdb3-c7bc-4ea5-83a5-f19bf1cdfcad tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:33.378374 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6861bdb3-c7bc-4ea5-83a5-f19bf1cdfcad tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:33.386464 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6861bdb3-c7bc-4ea5-83a5-f19bf1cdfcad tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:33.387020 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6861bdb3-c7bc-4ea5-83a5-f19bf1cdfcad tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:33.387871 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6861bdb3-c7bc-4ea5-83a5-f19bf1cdfcad tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:33.388404 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6861bdb3-c7bc-4ea5-83a5-f19bf1cdfcad tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:33.447132 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6861bdb3-c7bc-4ea5-83a5-f19bf1cdfcad tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:33.452881 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6861bdb3-c7bc-4ea5-83a5-f19bf1cdfcad tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:33.453201 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-6861bdb3-c7bc-4ea5-83a5-f19bf1cdfcad tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lazy-loading 'fault' on Instance uuid 2c3132a4-8591-418d-8efe-7148c942eb3f {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:34:33.552513 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6861bdb3-c7bc-4ea5-83a5-f19bf1cdfcad tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:33.559537 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6861bdb3-c7bc-4ea5-83a5-f19bf1cdfcad tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 200 len: 1308 microversion: 2.1 time: 0.188842 May 09 04:34:33.569990 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 544/1092] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:33 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:34:33.731882 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-a7c13c1b-a0fe-4fa1-a3d6-f322d5393369 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:33.732617 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-a7c13c1b-a0fe-4fa1-a3d6-f322d5393369 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:33.740156 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7c13c1b-a0fe-4fa1-a3d6-f322d5393369 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:33.740612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7c13c1b-a0fe-4fa1-a3d6-f322d5393369 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:33.741845 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7c13c1b-a0fe-4fa1-a3d6-f322d5393369 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:33.742464 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-a7c13c1b-a0fe-4fa1-a3d6-f322d5393369 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:33.887727 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-a7c13c1b-a0fe-4fa1-a3d6-f322d5393369 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:33.895312 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-a7c13c1b-a0fe-4fa1-a3d6-f322d5393369 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1314 microversion: 2.1 time: 0.168440 May 09 04:34:33.895872 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 549/1093] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:33 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:34.578233 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b917a5a2-7607-4ff9-9000-d51fcd1a01e6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:34.578835 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b917a5a2-7607-4ff9-9000-d51fcd1a01e6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 2c3132a4-8591-418d-8efe-7148c942eb3f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:34.585183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b917a5a2-7607-4ff9-9000-d51fcd1a01e6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:34.585626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b917a5a2-7607-4ff9-9000-d51fcd1a01e6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:34.586378 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b917a5a2-7607-4ff9-9000-d51fcd1a01e6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:34.586812 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b917a5a2-7607-4ff9-9000-d51fcd1a01e6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:34.601259 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-b917a5a2-7607-4ff9-9000-d51fcd1a01e6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] HTTP exception thrown: Instance 2c3132a4-8591-418d-8efe-7148c942eb3f could not be found. May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b917a5a2-7607-4ff9-9000-d51fcd1a01e6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Request method failure captured: May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f HTTP/1.1 May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJmc8fmv2l5AJTzHF0diKZ-O16V6GGZJ8uTMvGeqW2bxbHy-AlBuYpCowStPagHOPZ3JZnqvRkcFDwnMckeIpbf0T7XpruaDcwIu0p4-03gOQmXoEAn01KKB1N01EsK-G5JWAmplt9MlnaCaU9zp60rdAhaqlmsml2Wv1zP_PLFfyS8 May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 3d6aeac77b6d4f1c8f912d7c5d91968f May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1478118256 May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:34:34.602898 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:34:34.604629 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d6aeac77b6d4f1c8f912d7c5d91968f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d6aeac77b6d4f1c8f912d7c5d91968f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d6aeac77b6d4f1c8f912d7c5d91968f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d6aeac77b6d4f1c8f912d7c5d91968f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:34:34.604629 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-VolumesSnapshotTestJSON-1478118256 May 09 04:34:34.604629 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 3d6aeac77b6d4f1c8f912d7c5d91968f May 09 04:34:34.604629 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1478118256 May 09 04:34:34.604629 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-VolumesSnapshotTestJSON-1478118256-project May 09 04:34:34.604629 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:34:34.604629 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:34:34.604629 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: ec0360cd80a040c5ae2f3f7a6ba01f75 May 09 04:34:34.604629 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-VolumesSnapshotTestJSON-1478118256-project May 09 04:34:34.604629 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:34:34.604629 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 2c3132a4-8591-418d-8efe-7148c942eb3f could not be found. May 09 04:34:34.604629 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '2c3132a4-8591-418d-8efe-7148c942eb3f'} May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c3132a4-8591-418d-8efe-7148c942eb3f could not be found. May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:34:34.605597 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c3132a4-8591-418d-8efe-7148c942eb3f could not be found. May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c3132a4-8591-418d-8efe-7148c942eb3f could not be found. May 09 04:34:34.607061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:34:34.608402 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b917a5a2-7607-4ff9-9000-d51fcd1a01e6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Returning 404 to user: Instance 2c3132a4-8591-418d-8efe-7148c942eb3f could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:34:34.608402 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b917a5a2-7607-4ff9-9000-d51fcd1a01e6 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f" status: 404 len: 111 microversion: 2.1 time: 0.030454 May 09 04:34:34.608402 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 545/1094] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:34 2022] GET /compute/v2.1/servers/2c3132a4-8591-418d-8efe-7148c942eb3f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:34:34.898418 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-f48dfa90-4bd2-4fbe-9426-a32011c4d98b req-f053ce1e-065f-4487-a09b-15afc36633c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73410bc3-c3fa-4312-b3f6-6f0e2d443e73", "tag": "c8a86a0f-64bd-4a20-836b-cb0b70321e24"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:34:34.913589 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9c6d5a6d-c811-4495-a576-b725a63a7e62 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:34.914585 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9c6d5a6d-c811-4495-a576-b725a63a7e62 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:34.921947 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c6d5a6d-c811-4495-a576-b725a63a7e62 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:34.922551 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c6d5a6d-c811-4495-a576-b725a63a7e62 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:34.923232 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-f48dfa90-4bd2-4fbe-9426-a32011c4d98b req-f053ce1e-065f-4487-a09b-15afc36633c5 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:34.923695 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c6d5a6d-c811-4495-a576-b725a63a7e62 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:34.924094 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-f48dfa90-4bd2-4fbe-9426-a32011c4d98b req-f053ce1e-065f-4487-a09b-15afc36633c5 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:34.924474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c6d5a6d-c811-4495-a576-b725a63a7e62 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:34.943466 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-f48dfa90-4bd2-4fbe-9426-a32011c4d98b req-f053ce1e-065f-4487-a09b-15afc36633c5 service nova] Creating event network-changed:c8a86a0f-64bd-4a20-836b-cb0b70321e24 for instance 73410bc3-c3fa-4312-b3f6-6f0e2d443e73 on hv-cinder-83800 May 09 04:34:34.953390 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-f48dfa90-4bd2-4fbe-9426-a32011c4d98b req-f053ce1e-065f-4487-a09b-15afc36633c5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057871 May 09 04:34:34.954068 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 550/1095] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:34:35.093678 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9c6d5a6d-c811-4495-a576-b725a63a7e62 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:35.100896 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9c6d5a6d-c811-4495-a576-b725a63a7e62 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1314 microversion: 2.1 time: 0.192089 May 09 04:34:35.101477 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 546/1096] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:34 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:36.118198 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1aa6edc6-c239-412e-9a42-37aa8131f2ce tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:36.118900 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1aa6edc6-c239-412e-9a42-37aa8131f2ce tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:36.125229 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1aa6edc6-c239-412e-9a42-37aa8131f2ce tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:36.125678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1aa6edc6-c239-412e-9a42-37aa8131f2ce tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:36.126439 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1aa6edc6-c239-412e-9a42-37aa8131f2ce tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:36.126876 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1aa6edc6-c239-412e-9a42-37aa8131f2ce tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:36.256169 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1aa6edc6-c239-412e-9a42-37aa8131f2ce tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:36.264383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1aa6edc6-c239-412e-9a42-37aa8131f2ce tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1314 microversion: 2.1 time: 0.150680 May 09 04:34:36.265491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 551/1097] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:36 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:37.281332 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8108539d-7c99-4193-a8be-828bd0a4dd48 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:37.281979 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8108539d-7c99-4193-a8be-828bd0a4dd48 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:37.288514 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8108539d-7c99-4193-a8be-828bd0a4dd48 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:37.288966 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8108539d-7c99-4193-a8be-828bd0a4dd48 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:37.289736 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8108539d-7c99-4193-a8be-828bd0a4dd48 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:37.290176 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8108539d-7c99-4193-a8be-828bd0a4dd48 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:37.441971 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8108539d-7c99-4193-a8be-828bd0a4dd48 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:37.449379 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8108539d-7c99-4193-a8be-828bd0a4dd48 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1314 microversion: 2.1 time: 0.172068 May 09 04:34:37.449949 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 547/1098] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:37 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:38.466950 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-95066a6a-1736-4893-beb0-1e82d484f303 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:38.468580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-95066a6a-1736-4893-beb0-1e82d484f303 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:38.475175 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-95066a6a-1736-4893-beb0-1e82d484f303 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:38.475714 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-95066a6a-1736-4893-beb0-1e82d484f303 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:38.476520 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-95066a6a-1736-4893-beb0-1e82d484f303 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:38.476960 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-95066a6a-1736-4893-beb0-1e82d484f303 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:38.608616 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-95066a6a-1736-4893-beb0-1e82d484f303 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:38.616169 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-95066a6a-1736-4893-beb0-1e82d484f303 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1314 microversion: 2.1 time: 0.153411 May 09 04:34:38.616746 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 552/1099] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:38 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:39.633639 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-256dcca5-7325-44bd-a77c-aca356b43560 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:39.634188 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-256dcca5-7325-44bd-a77c-aca356b43560 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:39.641328 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-256dcca5-7325-44bd-a77c-aca356b43560 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:39.641780 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-256dcca5-7325-44bd-a77c-aca356b43560 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:39.642546 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-256dcca5-7325-44bd-a77c-aca356b43560 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:39.642989 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-256dcca5-7325-44bd-a77c-aca356b43560 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:39.773786 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-256dcca5-7325-44bd-a77c-aca356b43560 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:39.781175 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-256dcca5-7325-44bd-a77c-aca356b43560 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1314 microversion: 2.1 time: 0.151573 May 09 04:34:39.781733 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 548/1100] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:39 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:40.797607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-cd81b8b5-611d-467e-9160-2a22339be71d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:40.798216 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-cd81b8b5-611d-467e-9160-2a22339be71d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:40.804591 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd81b8b5-611d-467e-9160-2a22339be71d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:40.805037 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd81b8b5-611d-467e-9160-2a22339be71d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:40.805800 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd81b8b5-611d-467e-9160-2a22339be71d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:40.806238 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd81b8b5-611d-467e-9160-2a22339be71d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:40.938452 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-cd81b8b5-611d-467e-9160-2a22339be71d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:40.946210 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-cd81b8b5-611d-467e-9160-2a22339be71d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1314 microversion: 2.1 time: 0.152449 May 09 04:34:40.946772 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 553/1101] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:40 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:41.676473 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-8f9e5ca5-074b-42b4-9b73-bf088b87be5f req-d89a50f4-f425-405b-87f1-62f8b0788597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73410bc3-c3fa-4312-b3f6-6f0e2d443e73", "name": "network-vif-plugged", "status": "completed", "tag": "c8a86a0f-64bd-4a20-836b-cb0b70321e24"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:34:41.684749 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-8f9e5ca5-074b-42b4-9b73-bf088b87be5f req-d89a50f4-f425-405b-87f1-62f8b0788597 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:41.685217 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-8f9e5ca5-074b-42b4-9b73-bf088b87be5f req-d89a50f4-f425-405b-87f1-62f8b0788597 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:41.699132 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-8f9e5ca5-074b-42b4-9b73-bf088b87be5f req-d89a50f4-f425-405b-87f1-62f8b0788597 service nova] Creating event network-vif-plugged:c8a86a0f-64bd-4a20-836b-cb0b70321e24 for instance 73410bc3-c3fa-4312-b3f6-6f0e2d443e73 on hv-cinder-83800 May 09 04:34:41.704308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-8f9e5ca5-074b-42b4-9b73-bf088b87be5f req-d89a50f4-f425-405b-87f1-62f8b0788597 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031833 May 09 04:34:41.704919 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 549/1102] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:34:41.962838 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c5e8bfaf-084e-4ea2-9de4-557254acd715 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:41.963384 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c5e8bfaf-084e-4ea2-9de4-557254acd715 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:41.970803 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c5e8bfaf-084e-4ea2-9de4-557254acd715 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:41.971250 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c5e8bfaf-084e-4ea2-9de4-557254acd715 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:41.972052 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c5e8bfaf-084e-4ea2-9de4-557254acd715 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:41.972491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c5e8bfaf-084e-4ea2-9de4-557254acd715 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:42.099991 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c5e8bfaf-084e-4ea2-9de4-557254acd715 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:42.107221 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c5e8bfaf-084e-4ea2-9de4-557254acd715 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1314 microversion: 2.1 time: 0.148331 May 09 04:34:42.107790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 554/1103] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:41 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:43.125278 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7b357e54-494b-4eca-ad93-b7f46b111322 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:43.126008 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7b357e54-494b-4eca-ad93-b7f46b111322 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:43.132306 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7b357e54-494b-4eca-ad93-b7f46b111322 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:43.132754 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7b357e54-494b-4eca-ad93-b7f46b111322 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:43.133518 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7b357e54-494b-4eca-ad93-b7f46b111322 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:43.133959 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7b357e54-494b-4eca-ad93-b7f46b111322 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:43.277194 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7b357e54-494b-4eca-ad93-b7f46b111322 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:43.286708 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7b357e54-494b-4eca-ad93-b7f46b111322 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1314 microversion: 2.1 time: 0.166164 May 09 04:34:43.287279 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 550/1104] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:43 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:44.303615 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c9b24468-222f-4c59-a860-cb2be76a0a6b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:44.304305 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c9b24468-222f-4c59-a860-cb2be76a0a6b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:44.310687 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c9b24468-222f-4c59-a860-cb2be76a0a6b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:44.311138 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c9b24468-222f-4c59-a860-cb2be76a0a6b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:44.312252 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c9b24468-222f-4c59-a860-cb2be76a0a6b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:44.312694 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c9b24468-222f-4c59-a860-cb2be76a0a6b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:44.456840 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1777011705", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452", "networks": [{"uuid": "627ae9bf-4485-4d21-8d33-ad26d60fe27f"}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:34:44.509500 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c9b24468-222f-4c59-a860-cb2be76a0a6b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:44.512965 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] validate_networks() for [('627ae9bf-4485-4d21-8d33-ad26d60fe27f', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:34:44.518005 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c9b24468-222f-4c59-a860-cb2be76a0a6b tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1314 microversion: 2.1 time: 0.218239 May 09 04:34:44.518623 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 555/1105] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:44 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:45.060338 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:34:45.061276 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:34:45.062200 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:34:45.062910 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:34:45.063334 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:34:45.072588 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:45.073071 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:45.073874 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:45.074316 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:45.092055 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Getting quotas for project 3d6aeac77b6d4f1c8f912d7c5d91968f. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:34:45.097489 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Getting quotas for user ec0360cd80a040c5ae2f3f7a6ba01f75 and project 3d6aeac77b6d4f1c8f912d7c5d91968f. Resources: {'cores', 'ram', 'instances'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:34:45.108896 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:34:45.111196 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:34:45.157840 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-599696cd-8ae7-4f5e-880e-e4501ae31cc1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705493 May 09 04:34:45.158703 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 551/1106] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:34:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 09 04:34:45.168441 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-b8199503-8d6f-4d62-9e57-626789981c6c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:45.169213 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-b8199503-8d6f-4d62-9e57-626789981c6c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:45.231283 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-b8199503-8d6f-4d62-9e57-626789981c6c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:45.238967 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-b8199503-8d6f-4d62-9e57-626789981c6c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1219 microversion: 2.1 time: 0.074424 May 09 04:34:45.239634 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 556/1107] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:45 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:45.536101 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f6ddcb7d-cbbd-4f9f-8db2-57d5b8fc9da8 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:45.536717 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f6ddcb7d-cbbd-4f9f-8db2-57d5b8fc9da8 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:45.544219 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6ddcb7d-cbbd-4f9f-8db2-57d5b8fc9da8 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:45.544764 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6ddcb7d-cbbd-4f9f-8db2-57d5b8fc9da8 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:45.545642 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6ddcb7d-cbbd-4f9f-8db2-57d5b8fc9da8 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:45.546285 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6ddcb7d-cbbd-4f9f-8db2-57d5b8fc9da8 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:45.740683 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f6ddcb7d-cbbd-4f9f-8db2-57d5b8fc9da8 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:45.751615 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f6ddcb7d-cbbd-4f9f-8db2-57d5b8fc9da8 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1498 microversion: 2.1 time: 0.220351 May 09 04:34:45.752253 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 552/1108] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:45 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1498 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:46.256554 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-8a772377-f48c-44c4-88f9-7d13ba0818af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:46.257319 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-8a772377-f48c-44c4-88f9-7d13ba0818af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:46.265930 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8a772377-f48c-44c4-88f9-7d13ba0818af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:46.266677 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8a772377-f48c-44c4-88f9-7d13ba0818af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:46.267670 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8a772377-f48c-44c4-88f9-7d13ba0818af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:46.269880 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-8a772377-f48c-44c4-88f9-7d13ba0818af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:46.367908 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f3bab6bd-4725-40a1-b390-bc974d60e100 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:46.368494 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f3bab6bd-4725-40a1-b390-bc974d60e100 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:46.376248 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3bab6bd-4725-40a1-b390-bc974d60e100 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:46.376999 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3bab6bd-4725-40a1-b390-bc974d60e100 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:46.378047 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3bab6bd-4725-40a1-b390-bc974d60e100 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:46.378720 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3bab6bd-4725-40a1-b390-bc974d60e100 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:46.383758 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-8a772377-f48c-44c4-88f9-7d13ba0818af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:46.394046 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-8a772377-f48c-44c4-88f9-7d13ba0818af tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1279 microversion: 2.1 time: 0.141820 May 09 04:34:46.394631 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 557/1109] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:46 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1279 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:46.408820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f3bab6bd-4725-40a1-b390-bc974d60e100 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:34:46.492271 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f3bab6bd-4725-40a1-b390-bc974d60e100 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "DELETE /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 204 len: 0 microversion: 2.1 time: 0.130675 May 09 04:34:46.493041 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 553/1110] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:34:46 2022] DELETE /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 04:34:46.501778 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-22ac0f11-3b73-497a-8159-e93baaa5515d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:46.502428 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-22ac0f11-3b73-497a-8159-e93baaa5515d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:46.508306 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-22ac0f11-3b73-497a-8159-e93baaa5515d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:46.508763 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-22ac0f11-3b73-497a-8159-e93baaa5515d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:46.509905 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-22ac0f11-3b73-497a-8159-e93baaa5515d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:46.510344 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-22ac0f11-3b73-497a-8159-e93baaa5515d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:46.672740 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-22ac0f11-3b73-497a-8159-e93baaa5515d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:46.680260 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-22ac0f11-3b73-497a-8159-e93baaa5515d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1504 microversion: 2.1 time: 0.182862 May 09 04:34:46.680846 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 558/1111] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:46 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:47.411167 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b02c9ab7-bb5a-4c44-ab4a-df7c00e706c1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:47.411876 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b02c9ab7-bb5a-4c44-ab4a-df7c00e706c1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:47.418253 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b02c9ab7-bb5a-4c44-ab4a-df7c00e706c1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:47.418706 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b02c9ab7-bb5a-4c44-ab4a-df7c00e706c1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:47.419467 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b02c9ab7-bb5a-4c44-ab4a-df7c00e706c1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:47.419933 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b02c9ab7-bb5a-4c44-ab4a-df7c00e706c1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:47.558175 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b02c9ab7-bb5a-4c44-ab4a-df7c00e706c1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:47.566236 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b02c9ab7-bb5a-4c44-ab4a-df7c00e706c1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.159441 May 09 04:34:47.567021 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 554/1112] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:47 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:47.699294 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-38949ae0-8caf-4ddb-adb5-08eb7c2e2e89 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:47.700815 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-38949ae0-8caf-4ddb-adb5-08eb7c2e2e89 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:47.707789 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-38949ae0-8caf-4ddb-adb5-08eb7c2e2e89 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:47.708770 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-38949ae0-8caf-4ddb-adb5-08eb7c2e2e89 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:47.709552 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-38949ae0-8caf-4ddb-adb5-08eb7c2e2e89 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:47.709988 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-38949ae0-8caf-4ddb-adb5-08eb7c2e2e89 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:47.853614 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-38949ae0-8caf-4ddb-adb5-08eb7c2e2e89 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:47.861899 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-38949ae0-8caf-4ddb-adb5-08eb7c2e2e89 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1504 microversion: 2.1 time: 0.166792 May 09 04:34:47.887068 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 559/1113] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:47 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:48.475218 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-2b20b885-4ac6-4c91-af14-4dd886e01d8c req-968118a9-4ef1-417a-a057-6dce80a5ff99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32634c8a-6440-473b-b92d-d26eee7a05d6", "tag": "ffe15ce2-3cdd-46f0-b2ac-2bd283e68838"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:34:48.493077 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-2b20b885-4ac6-4c91-af14-4dd886e01d8c req-968118a9-4ef1-417a-a057-6dce80a5ff99 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:48.493550 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-2b20b885-4ac6-4c91-af14-4dd886e01d8c req-968118a9-4ef1-417a-a057-6dce80a5ff99 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:48.505788 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-2b20b885-4ac6-4c91-af14-4dd886e01d8c req-968118a9-4ef1-417a-a057-6dce80a5ff99 service nova] Creating event network-changed:ffe15ce2-3cdd-46f0-b2ac-2bd283e68838 for instance 32634c8a-6440-473b-b92d-d26eee7a05d6 on hv-cinder-83800 May 09 04:34:48.510661 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-2b20b885-4ac6-4c91-af14-4dd886e01d8c req-968118a9-4ef1-417a-a057-6dce80a5ff99 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039139 May 09 04:34:48.511280 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 555/1114] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:34:48.583319 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-23589fa7-9be9-4499-acbe-be28745d1d50 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:48.584165 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-23589fa7-9be9-4499-acbe-be28745d1d50 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:48.592919 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-23589fa7-9be9-4499-acbe-be28745d1d50 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:48.593758 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-23589fa7-9be9-4499-acbe-be28745d1d50 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:48.594648 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-23589fa7-9be9-4499-acbe-be28745d1d50 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:48.595174 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-23589fa7-9be9-4499-acbe-be28745d1d50 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:48.756642 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-23589fa7-9be9-4499-acbe-be28745d1d50 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:48.767270 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-23589fa7-9be9-4499-acbe-be28745d1d50 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.187633 May 09 04:34:48.768254 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 560/1115] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:48 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:48.879757 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e63690d8-9522-4017-b162-dd914bcbc559 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:48.880516 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e63690d8-9522-4017-b162-dd914bcbc559 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:48.886706 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e63690d8-9522-4017-b162-dd914bcbc559 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:48.887141 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e63690d8-9522-4017-b162-dd914bcbc559 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:48.887920 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e63690d8-9522-4017-b162-dd914bcbc559 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:48.888354 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e63690d8-9522-4017-b162-dd914bcbc559 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:49.002741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e63690d8-9522-4017-b162-dd914bcbc559 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:49.010748 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e63690d8-9522-4017-b162-dd914bcbc559 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1462 microversion: 2.1 time: 0.135306 May 09 04:34:49.011332 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 556/1116] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:48 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1462 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:49.785054 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-cd4ddce8-b328-4b4e-969d-d9016d459e11 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:49.785746 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-cd4ddce8-b328-4b4e-969d-d9016d459e11 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:49.792003 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd4ddce8-b328-4b4e-969d-d9016d459e11 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:49.792448 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd4ddce8-b328-4b4e-969d-d9016d459e11 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:49.793213 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd4ddce8-b328-4b4e-969d-d9016d459e11 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:49.793679 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-cd4ddce8-b328-4b4e-969d-d9016d459e11 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:49.924333 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-cd4ddce8-b328-4b4e-969d-d9016d459e11 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:49.931729 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-cd4ddce8-b328-4b4e-969d-d9016d459e11 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.151465 May 09 04:34:49.932322 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 561/1117] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:49 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:50.028714 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-faf0b5e6-29eb-4390-ae94-d834c0141a31 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:50.030054 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-faf0b5e6-29eb-4390-ae94-d834c0141a31 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:50.036780 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-faf0b5e6-29eb-4390-ae94-d834c0141a31 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:50.037214 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-faf0b5e6-29eb-4390-ae94-d834c0141a31 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:50.037992 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-faf0b5e6-29eb-4390-ae94-d834c0141a31 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:50.038425 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-faf0b5e6-29eb-4390-ae94-d834c0141a31 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:50.071061 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-faf0b5e6-29eb-4390-ae94-d834c0141a31 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:50.071638 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-faf0b5e6-29eb-4390-ae94-d834c0141a31 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:50.072399 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-faf0b5e6-29eb-4390-ae94-d834c0141a31 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lazy-loading 'fault' on Instance uuid 73410bc3-c3fa-4312-b3f6-6f0e2d443e73 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:34:50.120512 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-faf0b5e6-29eb-4390-ae94-d834c0141a31 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:50.128671 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-faf0b5e6-29eb-4390-ae94-d834c0141a31 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1304 microversion: 2.1 time: 0.103936 May 09 04:34:50.129252 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 557/1118] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:50 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:50.543068 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-b366bfe4-e059-4f27-b827-7e4f7cf26348 req-174562fd-154b-4c03-bcca-a43ca959f941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73410bc3-c3fa-4312-b3f6-6f0e2d443e73", "name": "network-vif-deleted", "tag": "c8a86a0f-64bd-4a20-836b-cb0b70321e24"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:34:50.551491 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-b366bfe4-e059-4f27-b827-7e4f7cf26348 req-174562fd-154b-4c03-bcca-a43ca959f941 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:50.551970 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-b366bfe4-e059-4f27-b827-7e4f7cf26348 req-174562fd-154b-4c03-bcca-a43ca959f941 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:50.562285 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-b366bfe4-e059-4f27-b827-7e4f7cf26348 req-174562fd-154b-4c03-bcca-a43ca959f941 service nova] Creating event network-vif-deleted:c8a86a0f-64bd-4a20-836b-cb0b70321e24 for instance 73410bc3-c3fa-4312-b3f6-6f0e2d443e73 on hv-cinder-83800 May 09 04:34:50.567886 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-b366bfe4-e059-4f27-b827-7e4f7cf26348 req-174562fd-154b-4c03-bcca-a43ca959f941 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028456 May 09 04:34:50.568481 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 562/1119] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:34:50.950640 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d0539cc7-63ea-40da-aaf9-cf611ff0dedd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:50.951180 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d0539cc7-63ea-40da-aaf9-cf611ff0dedd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:50.957293 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d0539cc7-63ea-40da-aaf9-cf611ff0dedd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:50.957741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d0539cc7-63ea-40da-aaf9-cf611ff0dedd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:50.958502 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d0539cc7-63ea-40da-aaf9-cf611ff0dedd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:50.958934 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d0539cc7-63ea-40da-aaf9-cf611ff0dedd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:51.084378 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d0539cc7-63ea-40da-aaf9-cf611ff0dedd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:51.091862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d0539cc7-63ea-40da-aaf9-cf611ff0dedd tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.145209 May 09 04:34:51.092455 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 558/1120] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:50 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:51.147421 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-092b0931-5458-41b7-a4f3-8f1d26f105ab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:51.148196 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-092b0931-5458-41b7-a4f3-8f1d26f105ab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:51.154397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-092b0931-5458-41b7-a4f3-8f1d26f105ab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:51.154854 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-092b0931-5458-41b7-a4f3-8f1d26f105ab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:51.155625 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-092b0931-5458-41b7-a4f3-8f1d26f105ab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:51.156100 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-092b0931-5458-41b7-a4f3-8f1d26f105ab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:51.188238 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-092b0931-5458-41b7-a4f3-8f1d26f105ab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:51.188705 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-092b0931-5458-41b7-a4f3-8f1d26f105ab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:51.189147 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.objects.instance [None req-092b0931-5458-41b7-a4f3-8f1d26f105ab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lazy-loading 'fault' on Instance uuid 73410bc3-c3fa-4312-b3f6-6f0e2d443e73 {{(pid=117033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:34:51.230098 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-092b0931-5458-41b7-a4f3-8f1d26f105ab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:51.237614 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-092b0931-5458-41b7-a4f3-8f1d26f105ab tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1304 microversion: 2.1 time: 0.094822 May 09 04:34:51.238175 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 563/1121] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:51 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:52.109414 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c75f6207-4bab-47ed-b3c7-7cff3d58ba2f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:52.110660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c75f6207-4bab-47ed-b3c7-7cff3d58ba2f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:52.117012 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c75f6207-4bab-47ed-b3c7-7cff3d58ba2f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:52.117456 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c75f6207-4bab-47ed-b3c7-7cff3d58ba2f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:52.118208 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c75f6207-4bab-47ed-b3c7-7cff3d58ba2f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:52.118639 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c75f6207-4bab-47ed-b3c7-7cff3d58ba2f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:52.246421 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c75f6207-4bab-47ed-b3c7-7cff3d58ba2f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:52.254202 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-ab86109b-5283-45fe-88b1-2670030bc61d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:52.254735 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c75f6207-4bab-47ed-b3c7-7cff3d58ba2f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.148853 May 09 04:34:52.254858 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-ab86109b-5283-45fe-88b1-2670030bc61d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:52.254952 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 559/1122] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:52 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:52.261455 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ab86109b-5283-45fe-88b1-2670030bc61d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:52.261903 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ab86109b-5283-45fe-88b1-2670030bc61d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:52.262677 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ab86109b-5283-45fe-88b1-2670030bc61d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:52.263112 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ab86109b-5283-45fe-88b1-2670030bc61d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:52.294218 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ab86109b-5283-45fe-88b1-2670030bc61d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:52.294664 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-ab86109b-5283-45fe-88b1-2670030bc61d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:52.295106 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.objects.instance [None req-ab86109b-5283-45fe-88b1-2670030bc61d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lazy-loading 'fault' on Instance uuid 73410bc3-c3fa-4312-b3f6-6f0e2d443e73 {{(pid=117033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:34:52.335039 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-ab86109b-5283-45fe-88b1-2670030bc61d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09dd259fed464b8c98749dd7e369e871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b03a05541e4ee38dc5f94a6e4bdc69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:52.342669 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-ab86109b-5283-45fe-88b1-2670030bc61d tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 200 len: 1304 microversion: 2.1 time: 0.092232 May 09 04:34:52.343228 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 564/1123] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:52 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:34:53.276386 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-31853cfd-ea5e-4ccf-b142-a732eec83934 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:53.284273 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-31853cfd-ea5e-4ccf-b142-a732eec83934 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:53.290493 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-31853cfd-ea5e-4ccf-b142-a732eec83934 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:53.290946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-31853cfd-ea5e-4ccf-b142-a732eec83934 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:53.291735 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-31853cfd-ea5e-4ccf-b142-a732eec83934 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:53.294422 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-31853cfd-ea5e-4ccf-b142-a732eec83934 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:53.361037 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-bfe5b38a-3994-4f36-947e-8da1aef2e060 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:53.362132 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-bfe5b38a-3994-4f36-947e-8da1aef2e060 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] [instance: 73410bc3-c3fa-4312-b3f6-6f0e2d443e73] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:53.378193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bfe5b38a-3994-4f36-947e-8da1aef2e060 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:53.378657 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bfe5b38a-3994-4f36-947e-8da1aef2e060 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:53.379455 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bfe5b38a-3994-4f36-947e-8da1aef2e060 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:53.379923 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bfe5b38a-3994-4f36-947e-8da1aef2e060 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:53.403675 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-bfe5b38a-3994-4f36-947e-8da1aef2e060 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] HTTP exception thrown: Instance 73410bc3-c3fa-4312-b3f6-6f0e2d443e73 could not be found. May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-bfe5b38a-3994-4f36-947e-8da1aef2e060 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Request method failure captured: May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 HTTP/1.1 May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJmzY_sP4oi_4ixYAq6lj5mK_ktfuCqJFB_MmJKYEIlRIVvg1WAGckzEs-K6up0UpsAcc0KZ9_Ok4LabHAio87udol8wYkHD09OiMYZb-KhQE92STNzgrOOc3xMzZRnLT49BuvOnZan5r7uyj0o8TvDpI_bwgOEVe4woF7v51YmcV0k May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: 20b03a05541e4ee38dc5f94a6e4bdc69 May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-VolumesActionsTest-898619899 May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:34:53.405696 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:34:53.407698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b03a05541e4ee38dc5f94a6e4bdc69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b03a05541e4ee38dc5f94a6e4bdc69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b03a05541e4ee38dc5f94a6e4bdc69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b03a05541e4ee38dc5f94a6e4bdc69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:34:53.407698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-VolumesActionsTest-898619899 May 09 04:34:53.407698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: 20b03a05541e4ee38dc5f94a6e4bdc69 May 09 04:34:53.407698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-VolumesActionsTest-898619899 May 09 04:34:53.407698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-VolumesActionsTest-898619899-project May 09 04:34:53.407698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:34:53.407698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:34:53.407698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: 09dd259fed464b8c98749dd7e369e871 May 09 04:34:53.407698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-VolumesActionsTest-898619899-project May 09 04:34:53.407698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:34:53.407698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance 73410bc3-c3fa-4312-b3f6-6f0e2d443e73 could not be found. May 09 04:34:53.407698 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': '73410bc3-c3fa-4312-b3f6-6f0e2d443e73'} May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73410bc3-c3fa-4312-b3f6-6f0e2d443e73 could not be found. May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:34:53.409118 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73410bc3-c3fa-4312-b3f6-6f0e2d443e73 could not be found. May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73410bc3-c3fa-4312-b3f6-6f0e2d443e73 could not be found. May 09 04:34:53.410407 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:34:53.411810 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-bfe5b38a-3994-4f36-947e-8da1aef2e060 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] Returning 404 to user: Instance 73410bc3-c3fa-4312-b3f6-6f0e2d443e73 could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:34:53.413188 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-bfe5b38a-3994-4f36-947e-8da1aef2e060 tempest-VolumesActionsTest-898619899 tempest-VolumesActionsTest-898619899-project] 10.222.0.44 "GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73" status: 404 len: 111 microversion: 2.1 time: 0.057137 May 09 04:34:53.419569 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 565/1124] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:53 2022] GET /compute/v2.1/servers/73410bc3-c3fa-4312-b3f6-6f0e2d443e73 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:34:53.445375 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-31853cfd-ea5e-4ccf-b142-a732eec83934 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:53.455428 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-31853cfd-ea5e-4ccf-b142-a732eec83934 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.188380 May 09 04:34:53.456096 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 560/1125] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:53 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:54.472394 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-9b13a605-bd09-4e98-9245-f66031af874e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:54.473012 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-9b13a605-bd09-4e98-9245-f66031af874e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:54.479297 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9b13a605-bd09-4e98-9245-f66031af874e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:54.479742 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9b13a605-bd09-4e98-9245-f66031af874e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:54.480547 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9b13a605-bd09-4e98-9245-f66031af874e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:54.480983 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-9b13a605-bd09-4e98-9245-f66031af874e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:54.612543 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-9b13a605-bd09-4e98-9245-f66031af874e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:54.620109 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-9b13a605-bd09-4e98-9245-f66031af874e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.151562 May 09 04:34:54.620659 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 566/1126] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:54 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:55.637677 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-85617067-d668-4bea-b4da-67e990f3e23e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:55.638349 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-85617067-d668-4bea-b4da-67e990f3e23e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:55.645213 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-85617067-d668-4bea-b4da-67e990f3e23e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:55.645593 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-85617067-d668-4bea-b4da-67e990f3e23e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:55.646355 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-85617067-d668-4bea-b4da-67e990f3e23e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:55.646782 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-85617067-d668-4bea-b4da-67e990f3e23e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:55.776096 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-85617067-d668-4bea-b4da-67e990f3e23e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:55.783457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-85617067-d668-4bea-b4da-67e990f3e23e tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.149631 May 09 04:34:55.784073 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 561/1127] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:55 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:56.800729 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-4cf3e472-699c-4b3c-beda-e3ddff39322f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:56.801353 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-4cf3e472-699c-4b3c-beda-e3ddff39322f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:56.807944 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4cf3e472-699c-4b3c-beda-e3ddff39322f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:56.808399 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4cf3e472-699c-4b3c-beda-e3ddff39322f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:56.809176 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4cf3e472-699c-4b3c-beda-e3ddff39322f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:56.809618 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-4cf3e472-699c-4b3c-beda-e3ddff39322f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:56.939574 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-4cf3e472-699c-4b3c-beda-e3ddff39322f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:56.947343 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-4cf3e472-699c-4b3c-beda-e3ddff39322f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.150445 May 09 04:34:56.947925 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 567/1128] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:56 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:57.964127 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-56a4c8ef-0f52-4acb-ad4d-35c461a2a94f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:57.964660 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-56a4c8ef-0f52-4acb-ad4d-35c461a2a94f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:57.971401 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-56a4c8ef-0f52-4acb-ad4d-35c461a2a94f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:57.972094 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-56a4c8ef-0f52-4acb-ad4d-35c461a2a94f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:57.972854 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-56a4c8ef-0f52-4acb-ad4d-35c461a2a94f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:57.973288 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-56a4c8ef-0f52-4acb-ad4d-35c461a2a94f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:58.098426 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-56a4c8ef-0f52-4acb-ad4d-35c461a2a94f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:58.105803 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-56a4c8ef-0f52-4acb-ad4d-35c461a2a94f tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.145659 May 09 04:34:58.106372 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 562/1129] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:57 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:59.122481 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c0b95359-504f-4c2a-853b-66285a5455f1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:34:59.123105 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c0b95359-504f-4c2a-853b-66285a5455f1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:34:59.130645 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c0b95359-504f-4c2a-853b-66285a5455f1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:59.131330 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c0b95359-504f-4c2a-853b-66285a5455f1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:59.132136 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c0b95359-504f-4c2a-853b-66285a5455f1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:59.132581 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c0b95359-504f-4c2a-853b-66285a5455f1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:59.261814 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c0b95359-504f-4c2a-853b-66285a5455f1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:34:59.269868 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c0b95359-504f-4c2a-853b-66285a5455f1 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.151253 May 09 04:34:59.270432 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 568/1130] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:34:59 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:34:59.808333 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-2c70cea0-dbd6-41e6-8cbd-ef3663359aeb req-cda42456-cac6-4849-8817-bf6434a36df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32634c8a-6440-473b-b92d-d26eee7a05d6", "name": "network-vif-plugged", "status": "completed", "tag": "ffe15ce2-3cdd-46f0-b2ac-2bd283e68838"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:34:59.818979 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-2c70cea0-dbd6-41e6-8cbd-ef3663359aeb req-cda42456-cac6-4849-8817-bf6434a36df0 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:34:59.819562 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-2c70cea0-dbd6-41e6-8cbd-ef3663359aeb req-cda42456-cac6-4849-8817-bf6434a36df0 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:34:59.832360 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-2c70cea0-dbd6-41e6-8cbd-ef3663359aeb req-cda42456-cac6-4849-8817-bf6434a36df0 service nova] Creating event network-vif-plugged:ffe15ce2-3cdd-46f0-b2ac-2bd283e68838 for instance 32634c8a-6440-473b-b92d-d26eee7a05d6 on hv-cinder-83800 May 09 04:34:59.837685 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-2c70cea0-dbd6-41e6-8cbd-ef3663359aeb req-cda42456-cac6-4849-8817-bf6434a36df0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033372 May 09 04:34:59.838715 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 563/1131] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:35:00.286925 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-bb07c7e9-00c0-4b1f-9022-15a9bb24e413 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:00.287535 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-bb07c7e9-00c0-4b1f-9022-15a9bb24e413 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:00.293790 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bb07c7e9-00c0-4b1f-9022-15a9bb24e413 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:00.294234 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bb07c7e9-00c0-4b1f-9022-15a9bb24e413 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:00.294993 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bb07c7e9-00c0-4b1f-9022-15a9bb24e413 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:00.295424 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-bb07c7e9-00c0-4b1f-9022-15a9bb24e413 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:00.424200 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-bb07c7e9-00c0-4b1f-9022-15a9bb24e413 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:00.431484 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-bb07c7e9-00c0-4b1f-9022-15a9bb24e413 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.149068 May 09 04:35:00.432151 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 569/1132] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:00 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:01.449311 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-aa858ee7-2e39-40f1-a189-22f59a3bab51 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:01.450006 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-aa858ee7-2e39-40f1-a189-22f59a3bab51 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:01.456419 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa858ee7-2e39-40f1-a189-22f59a3bab51 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:01.456865 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa858ee7-2e39-40f1-a189-22f59a3bab51 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:01.457653 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa858ee7-2e39-40f1-a189-22f59a3bab51 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:01.458088 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa858ee7-2e39-40f1-a189-22f59a3bab51 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:01.585725 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-aa858ee7-2e39-40f1-a189-22f59a3bab51 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:01.593391 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-aa858ee7-2e39-40f1-a189-22f59a3bab51 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.148701 May 09 04:35:01.593960 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 564/1133] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:01 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:02.610265 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-6b65a594-cc33-4840-8396-2383abc42b05 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:02.610786 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-6b65a594-cc33-4840-8396-2383abc42b05 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:02.617917 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6b65a594-cc33-4840-8396-2383abc42b05 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:02.618366 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6b65a594-cc33-4840-8396-2383abc42b05 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:02.619137 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6b65a594-cc33-4840-8396-2383abc42b05 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:02.619578 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-6b65a594-cc33-4840-8396-2383abc42b05 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:02.744002 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-6b65a594-cc33-4840-8396-2383abc42b05 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:02.751433 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-6b65a594-cc33-4840-8396-2383abc42b05 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.145159 May 09 04:35:02.752017 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 570/1134] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:02 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:03.767584 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-81ac30d6-36b5-4d69-81a0-9615ad6cf2fb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:03.768237 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-81ac30d6-36b5-4d69-81a0-9615ad6cf2fb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:03.774767 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-81ac30d6-36b5-4d69-81a0-9615ad6cf2fb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:03.775219 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-81ac30d6-36b5-4d69-81a0-9615ad6cf2fb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:03.776015 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-81ac30d6-36b5-4d69-81a0-9615ad6cf2fb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:03.776458 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-81ac30d6-36b5-4d69-81a0-9615ad6cf2fb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:03.900935 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-81ac30d6-36b5-4d69-81a0-9615ad6cf2fb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:03.908154 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-81ac30d6-36b5-4d69-81a0-9615ad6cf2fb tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.144512 May 09 04:35:03.908725 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 565/1135] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:03 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:04.925988 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-c48a08b4-6b28-441d-840f-4bee1126525a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:04.926599 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-c48a08b4-6b28-441d-840f-4bee1126525a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:04.932572 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c48a08b4-6b28-441d-840f-4bee1126525a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:04.933016 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c48a08b4-6b28-441d-840f-4bee1126525a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:04.933774 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c48a08b4-6b28-441d-840f-4bee1126525a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:04.934205 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-c48a08b4-6b28-441d-840f-4bee1126525a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:05.065939 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-c48a08b4-6b28-441d-840f-4bee1126525a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:05.073212 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-c48a08b4-6b28-441d-840f-4bee1126525a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.151481 May 09 04:35:05.073763 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 571/1136] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:04 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:06.094429 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0a5ab1f2-93d0-4c6f-966a-a9b335c2250a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:06.098944 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0a5ab1f2-93d0-4c6f-966a-a9b335c2250a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:06.110216 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a5ab1f2-93d0-4c6f-966a-a9b335c2250a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:06.110674 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a5ab1f2-93d0-4c6f-966a-a9b335c2250a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:06.111467 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a5ab1f2-93d0-4c6f-966a-a9b335c2250a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:06.111877 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a5ab1f2-93d0-4c6f-966a-a9b335c2250a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:06.256579 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0a5ab1f2-93d0-4c6f-966a-a9b335c2250a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:06.266437 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0a5ab1f2-93d0-4c6f-966a-a9b335c2250a tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1319 microversion: 2.1 time: 0.178565 May 09 04:35:06.267051 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 566/1137] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:06 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:07.285195 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-40020cbb-f00f-4409-b540-4576c2786295 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:07.285907 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-40020cbb-f00f-4409-b540-4576c2786295 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:07.292992 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-40020cbb-f00f-4409-b540-4576c2786295 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:07.293703 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-40020cbb-f00f-4409-b540-4576c2786295 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:07.294714 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-40020cbb-f00f-4409-b540-4576c2786295 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:07.295406 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-40020cbb-f00f-4409-b540-4576c2786295 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:07.439678 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-40020cbb-f00f-4409-b540-4576c2786295 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:07.449142 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-40020cbb-f00f-4409-b540-4576c2786295 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1507 microversion: 2.1 time: 0.167974 May 09 04:35:07.450208 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 572/1138] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:07 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:35:07.469511 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-02960778-5756-4d28-9d87-8a81e0ac9187 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5b001dd-202b-4c05-890a-81158e536f79", "device": "/dev/sdb"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:35:07.470631 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-02960778-5756-4d28-9d87-8a81e0ac9187 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:07.477925 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-02960778-5756-4d28-9d87-8a81e0ac9187 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:07.478385 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-02960778-5756-4d28-9d87-8a81e0ac9187 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:07.479301 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-02960778-5756-4d28-9d87-8a81e0ac9187 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:07.479735 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-02960778-5756-4d28-9d87-8a81e0ac9187 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:07.800435 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-02960778-5756-4d28-9d87-8a81e0ac9187 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "POST /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336437 May 09 04:35:07.801155 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 567/1139] 10.222.0.44 () {60 vars in 1322 bytes} [Mon May 9 04:35:07 2022] POST /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:35:30.804011 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-260291087", "imageRef": "469ef913-26f7-4a04-a8db-0616e10e1578", "flavorRef": "452"}} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:35:30.853566 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.network.neutron [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] validate_networks() for None {{(pid=117033) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 04:35:31.130677 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Flavor limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 04:35:31.131128 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Image limits 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 04:35:31.131627 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Flavor pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 04:35:31.132060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Image pref 0:0:0 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 04:35:31.132468 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.virt.hardware [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 04:35:31.141220 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:31.141674 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:31.142475 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:31.142953 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:31.159590 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Getting quotas for project 262ae6d900ad4cc7afa231a5f271935b. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 04:35:31.163610 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.quota [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Getting quotas for user 5bbb0e5de132476189fcd28284fa330e and project 262ae6d900ad4cc7afa231a5f271935b. Resources: {'cores', 'ram', 'instances'} {{(pid=117033) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 04:35:31.175339 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Going to run 1 instances... {{(pid=117033) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 04:35:31.177649 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='469ef913-26f7-4a04-a8db-0616e10e1578',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 04:35:31.223816 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-89f86bde-46f7-48d5-bfba-efb86622fb33 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.423599 May 09 04:35:31.224397 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 573/1140] 10.222.0.44 () {60 vars in 1146 bytes} [Mon May 9 04:35:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 04:35:31.236425 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d1ebe37d-a483-4882-a18a-398b2f672cb6 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:31.237349 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d1ebe37d-a483-4882-a18a-398b2f672cb6 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:31.322566 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d1ebe37d-a483-4882-a18a-398b2f672cb6 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbb0e5de132476189fcd28284fa330e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ae6d900ad4cc7afa231a5f271935b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:31.329830 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d1ebe37d-a483-4882-a18a-398b2f672cb6 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2" status: 200 len: 1214 microversion: 2.1 time: 0.098535 May 09 04:35:31.330954 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 568/1141] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:31 2022] GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:32.347589 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-98e956db-9224-4966-9057-fb9833d796ac tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:32.348345 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-98e956db-9224-4966-9057-fb9833d796ac tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:32.354597 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-98e956db-9224-4966-9057-fb9833d796ac tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:32.355130 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-98e956db-9224-4966-9057-fb9833d796ac tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:32.355940 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-98e956db-9224-4966-9057-fb9833d796ac tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:32.356391 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-98e956db-9224-4966-9057-fb9833d796ac tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:32.426144 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-98e956db-9224-4966-9057-fb9833d796ac tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbb0e5de132476189fcd28284fa330e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ae6d900ad4cc7afa231a5f271935b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:32.434100 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-98e956db-9224-4966-9057-fb9833d796ac tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2" status: 200 len: 1284 microversion: 2.1 time: 0.091108 May 09 04:35:32.434991 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 574/1142] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:32 2022] GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:33.452357 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c56c0ed3-93ab-405f-8d04-1c9a4b78a001 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:33.452975 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c56c0ed3-93ab-405f-8d04-1c9a4b78a001 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:33.461335 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c56c0ed3-93ab-405f-8d04-1c9a4b78a001 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:33.461443 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c56c0ed3-93ab-405f-8d04-1c9a4b78a001 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:33.462220 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c56c0ed3-93ab-405f-8d04-1c9a4b78a001 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:33.462665 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c56c0ed3-93ab-405f-8d04-1c9a4b78a001 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:33.671918 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c56c0ed3-93ab-405f-8d04-1c9a4b78a001 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbb0e5de132476189fcd28284fa330e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ae6d900ad4cc7afa231a5f271935b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:33.680632 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c56c0ed3-93ab-405f-8d04-1c9a4b78a001 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2" status: 200 len: 1314 microversion: 2.1 time: 0.232006 May 09 04:35:33.681810 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 569/1143] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:33 2022] GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:33.898410 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-056b48a5-01c9-40eb-8683-20a43cb9e78a req-4b1c68b8-480a-491d-8044-f12453829294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "645c23a0-c907-4872-8f96-b947077a6fa2", "tag": "db927311-0927-43ee-a7ae-cf9a0819829d"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:35:33.912608 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-056b48a5-01c9-40eb-8683-20a43cb9e78a req-4b1c68b8-480a-491d-8044-f12453829294 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:33.913174 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-056b48a5-01c9-40eb-8683-20a43cb9e78a req-4b1c68b8-480a-491d-8044-f12453829294 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:33.932142 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-056b48a5-01c9-40eb-8683-20a43cb9e78a req-4b1c68b8-480a-491d-8044-f12453829294 service nova] Creating event network-changed:db927311-0927-43ee-a7ae-cf9a0819829d for instance 645c23a0-c907-4872-8f96-b947077a6fa2 on hv-cinder-83800 May 09 04:35:33.937911 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-056b48a5-01c9-40eb-8683-20a43cb9e78a req-4b1c68b8-480a-491d-8044-f12453829294 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045913 May 09 04:35:33.939225 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 575/1144] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:35:34.696505 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9ea06062-060d-48e6-9f6d-798a06c57ab7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:34.697034 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9ea06062-060d-48e6-9f6d-798a06c57ab7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:34.698927 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-7dbed7d0-dd50-472c-a5df-89c9fedc4494 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:34.699649 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-7dbed7d0-dd50-472c-a5df-89c9fedc4494 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:34.703412 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9ea06062-060d-48e6-9f6d-798a06c57ab7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:34.703850 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9ea06062-060d-48e6-9f6d-798a06c57ab7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:34.704634 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9ea06062-060d-48e6-9f6d-798a06c57ab7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:34.705060 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9ea06062-060d-48e6-9f6d-798a06c57ab7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:34.706606 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7dbed7d0-dd50-472c-a5df-89c9fedc4494 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:34.707277 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7dbed7d0-dd50-472c-a5df-89c9fedc4494 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:34.708263 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7dbed7d0-dd50-472c-a5df-89c9fedc4494 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:34.708697 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-7dbed7d0-dd50-472c-a5df-89c9fedc4494 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:34.789229 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-9ea06062-060d-48e6-9f6d-798a06c57ab7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lazy-loading 'services' on Instance uuid 32634c8a-6440-473b-b92d-d26eee7a05d6 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:35:34.851415 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-7dbed7d0-dd50-472c-a5df-89c9fedc4494 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbb0e5de132476189fcd28284fa330e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ae6d900ad4cc7afa231a5f271935b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:34.858759 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-7dbed7d0-dd50-472c-a5df-89c9fedc4494 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2" status: 200 len: 1314 microversion: 2.1 time: 0.164108 May 09 04:35:34.859310 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 576/1145] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:34 2022] GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:35:34.868844 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9ea06062-060d-48e6-9f6d-798a06c57ab7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "DELETE /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6/os-volume_attachments/b5b001dd-202b-4c05-890a-81158e536f79" status: 202 len: 0 microversion: 2.1 time: 0.176133 May 09 04:35:34.869433 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 570/1146] 10.222.0.44 () {58 vars in 1415 bytes} [Mon May 9 04:35:34 2022] DELETE /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6/os-volume_attachments/b5b001dd-202b-4c05-890a-81158e536f79 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:35:35.876134 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f47057f5-4780-4952-b474-eba5dc7582cb tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:35.876797 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f47057f5-4780-4952-b474-eba5dc7582cb tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:35.883272 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f47057f5-4780-4952-b474-eba5dc7582cb tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:35.884616 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f47057f5-4780-4952-b474-eba5dc7582cb tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:35.885415 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f47057f5-4780-4952-b474-eba5dc7582cb tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:35.885855 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f47057f5-4780-4952-b474-eba5dc7582cb tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:36.024579 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f47057f5-4780-4952-b474-eba5dc7582cb tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbb0e5de132476189fcd28284fa330e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ae6d900ad4cc7afa231a5f271935b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:36.032196 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f47057f5-4780-4952-b474-eba5dc7582cb tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2" status: 200 len: 1314 microversion: 2.1 time: 0.159733 May 09 04:35:36.032962 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 577/1147] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:35 2022] GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:37.039626 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e5d20464-4255-4ccf-92b8-f544bcbb8cfa tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:37.040276 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e5d20464-4255-4ccf-92b8-f544bcbb8cfa tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:37.046304 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e5d20464-4255-4ccf-92b8-f544bcbb8cfa tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:37.046751 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e5d20464-4255-4ccf-92b8-f544bcbb8cfa tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:37.047505 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e5d20464-4255-4ccf-92b8-f544bcbb8cfa tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:37.047960 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e5d20464-4255-4ccf-92b8-f544bcbb8cfa tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:37.058628 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-5edbc325-173a-4e0e-91ee-e02a54180db8 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:37.059254 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-5edbc325-173a-4e0e-91ee-e02a54180db8 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:37.066469 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5edbc325-173a-4e0e-91ee-e02a54180db8 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:37.066930 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5edbc325-173a-4e0e-91ee-e02a54180db8 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:37.067723 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5edbc325-173a-4e0e-91ee-e02a54180db8 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:37.068189 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-5edbc325-173a-4e0e-91ee-e02a54180db8 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:37.076699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e5d20464-4255-4ccf-92b8-f544bcbb8cfa tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:35:37.158170 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e5d20464-4255-4ccf-92b8-f544bcbb8cfa tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "DELETE /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 204 len: 0 microversion: 2.1 time: 0.122883 May 09 04:35:37.159661 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 571/1148] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:35:37 2022] DELETE /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:35:37.167828 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1309e81d-5719-4689-9b5c-3230c0c2ce8c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:37.168555 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1309e81d-5719-4689-9b5c-3230c0c2ce8c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:37.175480 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1309e81d-5719-4689-9b5c-3230c0c2ce8c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:37.175957 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1309e81d-5719-4689-9b5c-3230c0c2ce8c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:37.176746 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1309e81d-5719-4689-9b5c-3230c0c2ce8c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:37.177187 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1309e81d-5719-4689-9b5c-3230c0c2ce8c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:37.207221 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-5edbc325-173a-4e0e-91ee-e02a54180db8 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbb0e5de132476189fcd28284fa330e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ae6d900ad4cc7afa231a5f271935b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:37.217329 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-5edbc325-173a-4e0e-91ee-e02a54180db8 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2" status: 200 len: 1314 microversion: 2.1 time: 0.162192 May 09 04:35:37.217939 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 578/1149] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:37 2022] GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:35:37.317705 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1309e81d-5719-4689-9b5c-3230c0c2ce8c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:37.325094 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1309e81d-5719-4689-9b5c-3230c0c2ce8c tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1513 microversion: 2.1 time: 0.161363 May 09 04:35:37.325676 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 572/1150] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:37 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:35:37.937682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-8cfd59be-765b-4012-b266-ce89460e69d7 req-f9a6ffc3-53f8-4cf7-8e3a-2a4cbed7dfa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645c23a0-c907-4872-8f96-b947077a6fa2", "name": "network-vif-plugged", "status": "completed", "tag": "db927311-0927-43ee-a7ae-cf9a0819829d"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:35:37.945898 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-8cfd59be-765b-4012-b266-ce89460e69d7 req-f9a6ffc3-53f8-4cf7-8e3a-2a4cbed7dfa3 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:37.946344 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-8cfd59be-765b-4012-b266-ce89460e69d7 req-f9a6ffc3-53f8-4cf7-8e3a-2a4cbed7dfa3 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:37.957924 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-8cfd59be-765b-4012-b266-ce89460e69d7 req-f9a6ffc3-53f8-4cf7-8e3a-2a4cbed7dfa3 service nova] Creating event network-vif-plugged:db927311-0927-43ee-a7ae-cf9a0819829d for instance 645c23a0-c907-4872-8f96-b947077a6fa2 on hv-cinder-83800 May 09 04:35:37.962563 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-8cfd59be-765b-4012-b266-ce89460e69d7 req-f9a6ffc3-53f8-4cf7-8e3a-2a4cbed7dfa3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028641 May 09 04:35:37.963373 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 579/1151] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:35:38.234552 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-56088a3d-8ed3-4969-a8b8-753d2198c06c tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:38.235165 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-56088a3d-8ed3-4969-a8b8-753d2198c06c tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:38.241897 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-56088a3d-8ed3-4969-a8b8-753d2198c06c tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:38.242352 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-56088a3d-8ed3-4969-a8b8-753d2198c06c tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:38.243106 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-56088a3d-8ed3-4969-a8b8-753d2198c06c tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:38.243538 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-56088a3d-8ed3-4969-a8b8-753d2198c06c tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:38.343649 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-f23d8c55-6131-459f-b6a2-bc349dd52396 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:38.344378 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-f23d8c55-6131-459f-b6a2-bc349dd52396 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:38.350635 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f23d8c55-6131-459f-b6a2-bc349dd52396 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:38.351091 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f23d8c55-6131-459f-b6a2-bc349dd52396 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:38.351875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f23d8c55-6131-459f-b6a2-bc349dd52396 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:38.352337 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-f23d8c55-6131-459f-b6a2-bc349dd52396 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:38.371630 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-56088a3d-8ed3-4969-a8b8-753d2198c06c tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbb0e5de132476189fcd28284fa330e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ae6d900ad4cc7afa231a5f271935b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:38.379361 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-56088a3d-8ed3-4969-a8b8-753d2198c06c tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2" status: 200 len: 1314 microversion: 2.1 time: 0.148195 May 09 04:35:38.379990 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 573/1152] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:38 2022] GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:38.485483 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-f23d8c55-6131-459f-b6a2-bc349dd52396 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:38.492945 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-f23d8c55-6131-459f-b6a2-bc349dd52396 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1513 microversion: 2.1 time: 0.154225 May 09 04:35:38.493518 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 580/1153] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:38 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:35:39.397126 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bb65cf8c-76ce-4484-98bc-7dd8144f5aec tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:39.397657 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-bb65cf8c-76ce-4484-98bc-7dd8144f5aec tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:39.404032 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bb65cf8c-76ce-4484-98bc-7dd8144f5aec tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:39.404489 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bb65cf8c-76ce-4484-98bc-7dd8144f5aec tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:39.405258 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bb65cf8c-76ce-4484-98bc-7dd8144f5aec tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:39.405712 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bb65cf8c-76ce-4484-98bc-7dd8144f5aec tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:39.511628 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-24206373-f5b7-4400-b07e-bd2dc161a1d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:39.512293 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-24206373-f5b7-4400-b07e-bd2dc161a1d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:39.518875 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-24206373-f5b7-4400-b07e-bd2dc161a1d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:39.519382 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-24206373-f5b7-4400-b07e-bd2dc161a1d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:39.520383 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-24206373-f5b7-4400-b07e-bd2dc161a1d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:39.520865 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-24206373-f5b7-4400-b07e-bd2dc161a1d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:39.583854 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-24206373-f5b7-4400-b07e-bd2dc161a1d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:39.591609 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-24206373-f5b7-4400-b07e-bd2dc161a1d7 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1471 microversion: 2.1 time: 0.083848 May 09 04:35:39.592293 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 581/1154] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:39 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1471 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:39.596627 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [req-9aa8ae8f-5a8f-45a8-bf07-04cc78c4ade9 req-094a8493-0765-440b-8ddc-f043bc83c7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32634c8a-6440-473b-b92d-d26eee7a05d6", "name": "network-vif-deleted", "tag": "ffe15ce2-3cdd-46f0-b2ac-2bd283e68838"}]} {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:35:39.605456 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-9aa8ae8f-5a8f-45a8-bf07-04cc78c4ade9 req-094a8493-0765-440b-8ddc-f043bc83c7f4 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:39.605932 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [req-9aa8ae8f-5a8f-45a8-bf07-04cc78c4ade9 req-094a8493-0765-440b-8ddc-f043bc83c7f4 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:39.606143 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bb65cf8c-76ce-4484-98bc-7dd8144f5aec tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbb0e5de132476189fcd28284fa330e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ae6d900ad4cc7afa231a5f271935b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:39.614101 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bb65cf8c-76ce-4484-98bc-7dd8144f5aec tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2" status: 200 len: 1314 microversion: 2.1 time: 0.220959 May 09 04:35:39.614804 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 574/1155] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:39 2022] GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:39.619840 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.compute.server_external_events [req-9aa8ae8f-5a8f-45a8-bf07-04cc78c4ade9 req-094a8493-0765-440b-8ddc-f043bc83c7f4 service nova] Creating event network-vif-deleted:ffe15ce2-3cdd-46f0-b2ac-2bd283e68838 for instance 32634c8a-6440-473b-b92d-d26eee7a05d6 on hv-cinder-83800 May 09 04:35:39.625035 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [req-9aa8ae8f-5a8f-45a8-bf07-04cc78c4ade9 req-094a8493-0765-440b-8ddc-f043bc83c7f4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031630 May 09 04:35:39.625615 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 582/1156] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:35:40.609453 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-49da7147-11f1-404a-b4fd-d7b9625c8a36 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:40.610000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-49da7147-11f1-404a-b4fd-d7b9625c8a36 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:40.616520 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-49da7147-11f1-404a-b4fd-d7b9625c8a36 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:40.616971 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-49da7147-11f1-404a-b4fd-d7b9625c8a36 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:40.617733 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-49da7147-11f1-404a-b4fd-d7b9625c8a36 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:40.618175 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-49da7147-11f1-404a-b4fd-d7b9625c8a36 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:40.631747 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-dbcc874e-7236-4990-b22e-7a7bfa680120 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:40.632480 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-dbcc874e-7236-4990-b22e-7a7bfa680120 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:40.638928 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dbcc874e-7236-4990-b22e-7a7bfa680120 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:40.639379 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dbcc874e-7236-4990-b22e-7a7bfa680120 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:40.640189 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dbcc874e-7236-4990-b22e-7a7bfa680120 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:40.640649 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-dbcc874e-7236-4990-b22e-7a7bfa680120 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:40.650460 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-49da7147-11f1-404a-b4fd-d7b9625c8a36 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:40.650916 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-49da7147-11f1-404a-b4fd-d7b9625c8a36 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:40.651367 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-49da7147-11f1-404a-b4fd-d7b9625c8a36 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lazy-loading 'fault' on Instance uuid 32634c8a-6440-473b-b92d-d26eee7a05d6 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:35:40.699431 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-49da7147-11f1-404a-b4fd-d7b9625c8a36 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0360cd80a040c5ae2f3f7a6ba01f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6aeac77b6d4f1c8f912d7c5d91968f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:40.717185 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-49da7147-11f1-404a-b4fd-d7b9625c8a36 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 200 len: 1309 microversion: 2.1 time: 0.111722 May 09 04:35:40.731498 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 575/1157] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:40 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:40.798275 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-dbcc874e-7236-4990-b22e-7a7bfa680120 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbb0e5de132476189fcd28284fa330e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ae6d900ad4cc7afa231a5f271935b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:40.806603 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-dbcc874e-7236-4990-b22e-7a7bfa680120 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2" status: 200 len: 1464 microversion: 2.1 time: 0.179732 May 09 04:35:40.807410 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 583/1158] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:40 2022] GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 => generated 1464 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 04:35:40.845624 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-747286c3-f5e6-4d8a-ad91-a49dfdc6fe68 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:40.846130 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-747286c3-f5e6-4d8a-ad91-a49dfdc6fe68 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:40.853012 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-747286c3-f5e6-4d8a-ad91-a49dfdc6fe68 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:40.853462 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-747286c3-f5e6-4d8a-ad91-a49dfdc6fe68 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:40.854227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-747286c3-f5e6-4d8a-ad91-a49dfdc6fe68 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:40.854661 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-747286c3-f5e6-4d8a-ad91-a49dfdc6fe68 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:40.879163 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-747286c3-f5e6-4d8a-ad91-a49dfdc6fe68 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:35:40.960441 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-747286c3-f5e6-4d8a-ad91-a49dfdc6fe68 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "DELETE /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2" status: 204 len: 0 microversion: 2.1 time: 0.118244 May 09 04:35:40.961111 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 576/1159] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:35:40 2022] DELETE /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:35:40.970466 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-84ee6dea-21d5-4293-81e4-b0a0f9134ba4 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:40.971080 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-84ee6dea-21d5-4293-81e4-b0a0f9134ba4 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:40.978356 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-84ee6dea-21d5-4293-81e4-b0a0f9134ba4 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:40.978812 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-84ee6dea-21d5-4293-81e4-b0a0f9134ba4 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:40.979587 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-84ee6dea-21d5-4293-81e4-b0a0f9134ba4 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:40.980059 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-84ee6dea-21d5-4293-81e4-b0a0f9134ba4 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:41.104159 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-84ee6dea-21d5-4293-81e4-b0a0f9134ba4 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbb0e5de132476189fcd28284fa330e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ae6d900ad4cc7afa231a5f271935b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:41.111505 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-84ee6dea-21d5-4293-81e4-b0a0f9134ba4 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2" status: 200 len: 1470 microversion: 2.1 time: 0.145176 May 09 04:35:41.112094 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 584/1160] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:40 2022] GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 => generated 1470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:41.735810 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c8a61459-a77f-4674-b2dc-6b42a4b00494 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:41.736543 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c8a61459-a77f-4674-b2dc-6b42a4b00494 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] [instance: 32634c8a-6440-473b-b92d-d26eee7a05d6] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:41.745687 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c8a61459-a77f-4674-b2dc-6b42a4b00494 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:41.746411 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c8a61459-a77f-4674-b2dc-6b42a4b00494 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:41.747249 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c8a61459-a77f-4674-b2dc-6b42a4b00494 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:41.747817 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c8a61459-a77f-4674-b2dc-6b42a4b00494 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:41.762522 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-c8a61459-a77f-4674-b2dc-6b42a4b00494 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] HTTP exception thrown: Instance 32634c8a-6440-473b-b92d-d26eee7a05d6 could not be found. May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c8a61459-a77f-4674-b2dc-6b42a4b00494 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Request method failure captured: May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 HTTP/1.1 May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJmc8fmv2l5AJTzHF0diKZ-O16V6GGZJ8uTMvGeqW2bxbHy-AlBuYpCowStPagHOPZ3JZnqvRkcFDwnMckeIpbf0T7XpruaDcwIu0p4-03gOQmXoEAn01KKB1N01EsK-G5JWAmplt9MlnaCaU9zp60rdAhaqlmsml2Wv1zP_PLFfyS8 May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 3d6aeac77b6d4f1c8f912d7c5d91968f May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1478118256 May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:35:41.764308 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:35:41.765950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3d6aeac77b6d4f1c8f912d7c5d91968f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d6aeac77b6d4f1c8f912d7c5d91968f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3d6aeac77b6d4f1c8f912d7c5d91968f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3d6aeac77b6d4f1c8f912d7c5d91968f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:35:41.765950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-VolumesSnapshotTestJSON-1478118256 May 09 04:35:41.765950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 3d6aeac77b6d4f1c8f912d7c5d91968f May 09 04:35:41.765950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1478118256 May 09 04:35:41.765950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-VolumesSnapshotTestJSON-1478118256-project May 09 04:35:41.765950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:35:41.765950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:35:41.765950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: ec0360cd80a040c5ae2f3f7a6ba01f75 May 09 04:35:41.765950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-VolumesSnapshotTestJSON-1478118256-project May 09 04:35:41.765950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:35:41.765950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 32634c8a-6440-473b-b92d-d26eee7a05d6 could not be found. May 09 04:35:41.765950 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '32634c8a-6440-473b-b92d-d26eee7a05d6'} May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32634c8a-6440-473b-b92d-d26eee7a05d6 could not be found. May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:35:41.766878 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32634c8a-6440-473b-b92d-d26eee7a05d6 could not be found. May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32634c8a-6440-473b-b92d-d26eee7a05d6 could not be found. May 09 04:35:41.768474 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:35:41.769806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c8a61459-a77f-4674-b2dc-6b42a4b00494 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] Returning 404 to user: Instance 32634c8a-6440-473b-b92d-d26eee7a05d6 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:35:41.769806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c8a61459-a77f-4674-b2dc-6b42a4b00494 tempest-VolumesSnapshotTestJSON-1478118256 tempest-VolumesSnapshotTestJSON-1478118256-project] 10.222.0.44 "GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6" status: 404 len: 111 microversion: 2.1 time: 0.034430 May 09 04:35:41.769806 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 577/1161] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:41 2022] GET /compute/v2.1/servers/32634c8a-6440-473b-b92d-d26eee7a05d6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:35:42.128769 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-724a191c-4607-4b56-af2d-751526bcb4b5 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:42.129489 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-724a191c-4607-4b56-af2d-751526bcb4b5 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:42.135835 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-724a191c-4607-4b56-af2d-751526bcb4b5 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:42.136315 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-724a191c-4607-4b56-af2d-751526bcb4b5 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:42.137081 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-724a191c-4607-4b56-af2d-751526bcb4b5 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:42.137577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-724a191c-4607-4b56-af2d-751526bcb4b5 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:42.268500 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-724a191c-4607-4b56-af2d-751526bcb4b5 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbb0e5de132476189fcd28284fa330e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ae6d900ad4cc7afa231a5f271935b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:42.276013 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-724a191c-4607-4b56-af2d-751526bcb4b5 tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2" status: 200 len: 1470 microversion: 2.1 time: 0.151118 May 09 04:35:42.276577 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 585/1162] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:42 2022] GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:42.865876 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-8f4efb93-de4b-4f25-9ae5-ec721553a2de req-3623979f-dfba-42de-9aa2-6f07924ce61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645c23a0-c907-4872-8f96-b947077a6fa2", "name": "network-vif-deleted", "tag": "db927311-0927-43ee-a7ae-cf9a0819829d"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:35:42.875024 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-8f4efb93-de4b-4f25-9ae5-ec721553a2de req-3623979f-dfba-42de-9aa2-6f07924ce61f service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:42.875511 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-8f4efb93-de4b-4f25-9ae5-ec721553a2de req-3623979f-dfba-42de-9aa2-6f07924ce61f service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:42.891000 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-8f4efb93-de4b-4f25-9ae5-ec721553a2de req-3623979f-dfba-42de-9aa2-6f07924ce61f service nova] Creating event network-vif-deleted:db927311-0927-43ee-a7ae-cf9a0819829d for instance 645c23a0-c907-4872-8f96-b947077a6fa2 on hv-cinder-83800 May 09 04:35:42.896885 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-8f4efb93-de4b-4f25-9ae5-ec721553a2de req-3623979f-dfba-42de-9aa2-6f07924ce61f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035192 May 09 04:35:42.900699 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 578/1163] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:35:43.294210 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-03626052-6193-408c-8379-31d2bc7b96bc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:43.294729 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-03626052-6193-408c-8379-31d2bc7b96bc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:43.301981 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-03626052-6193-408c-8379-31d2bc7b96bc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:43.302435 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-03626052-6193-408c-8379-31d2bc7b96bc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:43.303216 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-03626052-6193-408c-8379-31d2bc7b96bc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:43.303654 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-03626052-6193-408c-8379-31d2bc7b96bc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:43.334823 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-03626052-6193-408c-8379-31d2bc7b96bc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:43.335276 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-03626052-6193-408c-8379-31d2bc7b96bc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:43.335723 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.objects.instance [None req-03626052-6193-408c-8379-31d2bc7b96bc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lazy-loading 'fault' on Instance uuid 645c23a0-c907-4872-8f96-b947077a6fa2 {{(pid=117033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:35:43.379925 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-03626052-6193-408c-8379-31d2bc7b96bc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bbb0e5de132476189fcd28284fa330e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262ae6d900ad4cc7afa231a5f271935b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:35:43.386794 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-03626052-6193-408c-8379-31d2bc7b96bc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2" status: 200 len: 1304 microversion: 2.1 time: 0.096641 May 09 04:35:43.387367 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 586/1164] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:43 2022] GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:35:44.405046 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-47c7d610-1dbd-47ce-bb90-d4deaf30bddc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:35:44.405738 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-47c7d610-1dbd-47ce-bb90-d4deaf30bddc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] [instance: 645c23a0-c907-4872-8f96-b947077a6fa2] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:35:44.412900 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-47c7d610-1dbd-47ce-bb90-d4deaf30bddc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:44.413343 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-47c7d610-1dbd-47ce-bb90-d4deaf30bddc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:44.414092 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-47c7d610-1dbd-47ce-bb90-d4deaf30bddc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:35:44.414519 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-47c7d610-1dbd-47ce-bb90-d4deaf30bddc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:35:44.428357 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-47c7d610-1dbd-47ce-bb90-d4deaf30bddc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] HTTP exception thrown: Instance 645c23a0-c907-4872-8f96-b947077a6fa2 could not be found. May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-47c7d610-1dbd-47ce-bb90-d4deaf30bddc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Request method failure captured: May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 HTTP/1.1 May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJoQVDkJS53qf4d4xVxrFzvDxY3bcQWZPU8EhhI3fvFj21YPcwi4Uq43SX--K3WrTR3SxjqUr0PmRRuWOpTAqylKJ624_STr8aLjpuj_-npppnYJU4CLDmq9MuVfEcZrmEwp_1lNwK_TBLOyUt8meE1TD-16iWjdYt-98YJwDwiblw8 May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: 262ae6d900ad4cc7afa231a5f271935b May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-VolumesNegativeTest-1652497028 May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:35:44.429946 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:35:44.431533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/262ae6d900ad4cc7afa231a5f271935b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/262ae6d900ad4cc7afa231a5f271935b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/262ae6d900ad4cc7afa231a5f271935b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_262ae6d900ad4cc7afa231a5f271935b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:35:44.431533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-VolumesNegativeTest-1652497028 May 09 04:35:44.431533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: 262ae6d900ad4cc7afa231a5f271935b May 09 04:35:44.431533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-VolumesNegativeTest-1652497028 May 09 04:35:44.431533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-VolumesNegativeTest-1652497028-project May 09 04:35:44.431533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:35:44.431533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:35:44.431533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: 5bbb0e5de132476189fcd28284fa330e May 09 04:35:44.431533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-VolumesNegativeTest-1652497028-project May 09 04:35:44.431533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:35:44.431533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 645c23a0-c907-4872-8f96-b947077a6fa2 could not be found. May 09 04:35:44.431533 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '645c23a0-c907-4872-8f96-b947077a6fa2'} May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 645c23a0-c907-4872-8f96-b947077a6fa2 could not be found. May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:35:44.432507 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 645c23a0-c907-4872-8f96-b947077a6fa2 could not be found. May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 645c23a0-c907-4872-8f96-b947077a6fa2 could not be found. May 09 04:35:44.433986 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:35:44.435332 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-47c7d610-1dbd-47ce-bb90-d4deaf30bddc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] Returning 404 to user: Instance 645c23a0-c907-4872-8f96-b947077a6fa2 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:35:44.435332 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-47c7d610-1dbd-47ce-bb90-d4deaf30bddc tempest-VolumesNegativeTest-1652497028 tempest-VolumesNegativeTest-1652497028-project] 10.222.0.44 "GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2" status: 404 len: 111 microversion: 2.1 time: 0.030543 May 09 04:35:44.435332 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 579/1165] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:35:44 2022] GET /compute/v2.1/servers/645c23a0-c907-4872-8f96-b947077a6fa2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:36:11.988154 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-071267ce-784a-496b-a23f-fe8f5d162292 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:36:11.988691 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-071267ce-784a-496b-a23f-fe8f5d162292 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:36:11.995093 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-071267ce-784a-496b-a23f-fe8f5d162292 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:11.995617 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-071267ce-784a-496b-a23f-fe8f5d162292 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:11.996120 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-c7885644-8c82-4f33-8632-340629ccfbdf req-17cab6bd-e83e-4d9b-87e8-fb647a2757f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dcd6d81-e095-4cc4-9c05-276e02d3f1dc", "tag": "955434ea-3868-4ce0-a79f-ebf7e2af37c0"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:36:11.996553 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-071267ce-784a-496b-a23f-fe8f5d162292 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:11.997004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-071267ce-784a-496b-a23f-fe8f5d162292 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:12.005487 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-c7885644-8c82-4f33-8632-340629ccfbdf req-17cab6bd-e83e-4d9b-87e8-fb647a2757f9 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:12.005962 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-c7885644-8c82-4f33-8632-340629ccfbdf req-17cab6bd-e83e-4d9b-87e8-fb647a2757f9 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:12.017151 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-c7885644-8c82-4f33-8632-340629ccfbdf req-17cab6bd-e83e-4d9b-87e8-fb647a2757f9 service nova] Creating event network-changed:955434ea-3868-4ce0-a79f-ebf7e2af37c0 for instance 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc on hv-cinder-83800 May 09 04:36:12.023082 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-c7885644-8c82-4f33-8632-340629ccfbdf req-17cab6bd-e83e-4d9b-87e8-fb647a2757f9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030487 May 09 04:36:12.023684 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-071267ce-784a-496b-a23f-fe8f5d162292 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Going to try to terminate instance {{(pid=117033) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:36:12.024562 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 580/1166] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:36:12.115105 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-071267ce-784a-496b-a23f-fe8f5d162292 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 204 len: 0 microversion: 2.1 time: 0.130524 May 09 04:36:12.118888 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 587/1167] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:36:11 2022] DELETE /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:36:12.125521 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-99576e89-7f7e-43f6-92dd-bc75a3daf048 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:36:12.126648 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-99576e89-7f7e-43f6-92dd-bc75a3daf048 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:36:12.135376 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-99576e89-7f7e-43f6-92dd-bc75a3daf048 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:12.136135 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-99576e89-7f7e-43f6-92dd-bc75a3daf048 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:12.137163 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-99576e89-7f7e-43f6-92dd-bc75a3daf048 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:12.137776 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-99576e89-7f7e-43f6-92dd-bc75a3daf048 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:12.299691 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-99576e89-7f7e-43f6-92dd-bc75a3daf048 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:36:12.308321 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-99576e89-7f7e-43f6-92dd-bc75a3daf048 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1576 microversion: 2.1 time: 0.187096 May 09 04:36:12.308900 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 581/1168] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:36:12 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:36:13.383884 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-46071275-fc95-4b12-8e1e-5fac90a8dd1f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:36:13.384597 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-46071275-fc95-4b12-8e1e-5fac90a8dd1f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:36:13.390858 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-46071275-fc95-4b12-8e1e-5fac90a8dd1f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:13.391309 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-46071275-fc95-4b12-8e1e-5fac90a8dd1f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:13.392129 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-46071275-fc95-4b12-8e1e-5fac90a8dd1f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:13.392546 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-46071275-fc95-4b12-8e1e-5fac90a8dd1f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:13.520406 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-46071275-fc95-4b12-8e1e-5fac90a8dd1f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:36:13.527794 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-46071275-fc95-4b12-8e1e-5fac90a8dd1f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1576 microversion: 2.1 time: 0.148201 May 09 04:36:13.528389 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 588/1169] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:36:13 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:36:14.104835 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-1b7dc690-cfca-4ec9-82a4-a5c3a4ed2796 req-6167de9a-9680-4747-ad3f-965c9217ca13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dcd6d81-e095-4cc4-9c05-276e02d3f1dc", "name": "network-vif-deleted", "tag": "955434ea-3868-4ce0-a79f-ebf7e2af37c0"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:36:14.113649 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-1b7dc690-cfca-4ec9-82a4-a5c3a4ed2796 req-6167de9a-9680-4747-ad3f-965c9217ca13 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:14.114093 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-1b7dc690-cfca-4ec9-82a4-a5c3a4ed2796 req-6167de9a-9680-4747-ad3f-965c9217ca13 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:14.125169 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-1b7dc690-cfca-4ec9-82a4-a5c3a4ed2796 req-6167de9a-9680-4747-ad3f-965c9217ca13 service nova] Creating event network-vif-deleted:955434ea-3868-4ce0-a79f-ebf7e2af37c0 for instance 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc on hv-cinder-83800 May 09 04:36:14.130638 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-1b7dc690-cfca-4ec9-82a4-a5c3a4ed2796 req-6167de9a-9680-4747-ad3f-965c9217ca13 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029452 May 09 04:36:14.131237 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 582/1170] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:36:14.545433 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-18e554a3-2ed6-437a-8ded-fe3099ed09a6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:36:14.546044 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-18e554a3-2ed6-437a-8ded-fe3099ed09a6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:36:14.554008 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18e554a3-2ed6-437a-8ded-fe3099ed09a6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:14.554477 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18e554a3-2ed6-437a-8ded-fe3099ed09a6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:14.555243 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18e554a3-2ed6-437a-8ded-fe3099ed09a6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:14.555681 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18e554a3-2ed6-437a-8ded-fe3099ed09a6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:14.588200 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18e554a3-2ed6-437a-8ded-fe3099ed09a6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:14.588578 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-18e554a3-2ed6-437a-8ded-fe3099ed09a6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:14.589025 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.objects.instance [None req-18e554a3-2ed6-437a-8ded-fe3099ed09a6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lazy-loading 'fault' on Instance uuid 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc {{(pid=117033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 04:36:14.633348 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-18e554a3-2ed6-437a-8ded-fe3099ed09a6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:36:14.641628 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-18e554a3-2ed6-437a-8ded-fe3099ed09a6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 200 len: 1229 microversion: 2.1 time: 0.100012 May 09 04:36:14.642279 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 589/1171] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:36:14 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:36:15.661022 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b70703ab-0366-403d-bfe0-94453a3888d6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:36:15.661719 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b70703ab-0366-403d-bfe0-94453a3888d6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:36:15.667982 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b70703ab-0366-403d-bfe0-94453a3888d6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:15.668430 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b70703ab-0366-403d-bfe0-94453a3888d6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:15.669183 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b70703ab-0366-403d-bfe0-94453a3888d6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:15.669616 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b70703ab-0366-403d-bfe0-94453a3888d6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:15.683227 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-b70703ab-0366-403d-bfe0-94453a3888d6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] HTTP exception thrown: Instance 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc could not be found. May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b70703ab-0366-403d-bfe0-94453a3888d6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Request method failure captured: May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc HTTP/1.1 May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJhI51Wg1Mh0rXGOkYOhY83gb_85EjAt1dEmV1kwE0E_o-LiDKJllKOYr3RwG8f3fHxZOUeUK-csXwRQGpzve9cTiuCA61_bQOHZ34MipY7rEN8cB_wKoIShklm1dipRQISHpvPSUx9JtSjPLpJy7unxRoJ2iMKpKc2lIb5aD3hB-Co May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: b6223852af9c4361b99a24e7a49a7734 May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-TestVolumeBootPattern-1800052824 May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:36:15.684862 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:36:15.686523 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:36:15.686523 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-TestVolumeBootPattern-1800052824 May 09 04:36:15.686523 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: b6223852af9c4361b99a24e7a49a7734 May 09 04:36:15.686523 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800052824 May 09 04:36:15.686523 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-TestVolumeBootPattern-1800052824-project May 09 04:36:15.686523 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:36:15.686523 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:36:15.686523 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: cb34feb512764ec5b9ca25c30c3d7159 May 09 04:36:15.686523 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-TestVolumeBootPattern-1800052824-project May 09 04:36:15.686523 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:36:15.686523 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc could not be found. May 09 04:36:15.686523 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': '3dcd6d81-e095-4cc4-9c05-276e02d3f1dc'} May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc could not be found. May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:36:15.687457 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc could not be found. May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc could not be found. May 09 04:36:15.689117 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:36:15.690517 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b70703ab-0366-403d-bfe0-94453a3888d6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Returning 404 to user: Instance 3dcd6d81-e095-4cc4-9c05-276e02d3f1dc could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:36:15.690517 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b70703ab-0366-403d-bfe0-94453a3888d6 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc" status: 404 len: 111 microversion: 2.1 time: 0.029981 May 09 04:36:15.690517 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 583/1172] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:36:15 2022] GET /compute/v2.1/servers/3dcd6d81-e095-4cc4-9c05-276e02d3f1dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:36:19.028669 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-21c7b3f6-782b-4581-af1b-8fab24a518cf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:36:19.029195 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-21c7b3f6-782b-4581-af1b-8fab24a518cf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:36:19.030897 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-c24567da-7eb3-4f45-b847-2a7586b6cb32 req-4723bbc3-1f35-4f67-a6fc-048046057620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0064c5db-f056-49f6-a8ba-54c3f60c41ec", "tag": "e05ee7be-8781-44a0-8ae2-fb665919b80b"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:36:19.035828 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-21c7b3f6-782b-4581-af1b-8fab24a518cf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:19.036460 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-21c7b3f6-782b-4581-af1b-8fab24a518cf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:19.037060 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-21c7b3f6-782b-4581-af1b-8fab24a518cf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:19.037489 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-21c7b3f6-782b-4581-af1b-8fab24a518cf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:19.040396 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-c24567da-7eb3-4f45-b847-2a7586b6cb32 req-4723bbc3-1f35-4f67-a6fc-048046057620 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:19.040906 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-c24567da-7eb3-4f45-b847-2a7586b6cb32 req-4723bbc3-1f35-4f67-a6fc-048046057620 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:19.052965 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-c24567da-7eb3-4f45-b847-2a7586b6cb32 req-4723bbc3-1f35-4f67-a6fc-048046057620 service nova] Creating event network-changed:e05ee7be-8781-44a0-8ae2-fb665919b80b for instance 0064c5db-f056-49f6-a8ba-54c3f60c41ec on hv-cinder-83800 May 09 04:36:19.058443 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-c24567da-7eb3-4f45-b847-2a7586b6cb32 req-4723bbc3-1f35-4f67-a6fc-048046057620 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031395 May 09 04:36:19.059250 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 584/1173] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:36:19.063362 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-21c7b3f6-782b-4581-af1b-8fab24a518cf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Going to try to terminate instance {{(pid=117033) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 04:36:19.157429 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-21c7b3f6-782b-4581-af1b-8fab24a518cf tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 204 len: 0 microversion: 2.1 time: 0.132027 May 09 04:36:19.158365 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 590/1174] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:36:19 2022] DELETE /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 04:36:19.167161 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f6e723a0-e7ce-44fc-aa42-f4d5673eb352 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:36:19.168038 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f6e723a0-e7ce-44fc-aa42-f4d5673eb352 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:36:19.174463 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6e723a0-e7ce-44fc-aa42-f4d5673eb352 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:19.175818 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6e723a0-e7ce-44fc-aa42-f4d5673eb352 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:19.176863 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6e723a0-e7ce-44fc-aa42-f4d5673eb352 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:19.177304 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6e723a0-e7ce-44fc-aa42-f4d5673eb352 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:19.518163 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f6e723a0-e7ce-44fc-aa42-f4d5673eb352 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:36:19.525782 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f6e723a0-e7ce-44fc-aa42-f4d5673eb352 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1578 microversion: 2.1 time: 0.362988 May 09 04:36:19.526460 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 585/1175] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:36:19 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1578 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:36:20.543853 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1df337a2-3683-4e32-9dda-53961a182e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:36:20.544702 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1df337a2-3683-4e32-9dda-53961a182e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:36:20.552218 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1df337a2-3683-4e32-9dda-53961a182e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:20.552674 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1df337a2-3683-4e32-9dda-53961a182e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:20.553446 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1df337a2-3683-4e32-9dda-53961a182e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:20.553882 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1df337a2-3683-4e32-9dda-53961a182e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:20.740441 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.policy [None req-1df337a2-3683-4e32-9dda-53961a182e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb34feb512764ec5b9ca25c30c3d7159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6223852af9c4361b99a24e7a49a7734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117033) authorize /opt/stack/nova/nova/policy.py:199}} May 09 04:36:20.748153 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1df337a2-3683-4e32-9dda-53961a182e6f tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 200 len: 1578 microversion: 2.1 time: 0.208380 May 09 04:36:20.748727 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 591/1176] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:36:20 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 04:36:21.073604 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-a5b81e54-9f7f-4599-97c6-db9a83237003 req-dffdd210-911a-43a6-97d6-c51c98d39677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0064c5db-f056-49f6-a8ba-54c3f60c41ec", "name": "network-vif-deleted", "tag": "e05ee7be-8781-44a0-8ae2-fb665919b80b"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 04:36:21.082468 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-a5b81e54-9f7f-4599-97c6-db9a83237003 req-dffdd210-911a-43a6-97d6-c51c98d39677 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:21.082914 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-a5b81e54-9f7f-4599-97c6-db9a83237003 req-dffdd210-911a-43a6-97d6-c51c98d39677 service nova] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:21.095464 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-a5b81e54-9f7f-4599-97c6-db9a83237003 req-dffdd210-911a-43a6-97d6-c51c98d39677 service nova] Creating event network-vif-deleted:e05ee7be-8781-44a0-8ae2-fb665919b80b for instance 0064c5db-f056-49f6-a8ba-54c3f60c41ec on hv-cinder-83800 May 09 04:36:21.100393 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-a5b81e54-9f7f-4599-97c6-db9a83237003 req-dffdd210-911a-43a6-97d6-c51c98d39677 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030437 May 09 04:36:21.100988 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 586/1177] 10.222.0.44 () {64 vars in 1317 bytes} [Mon May 9 04:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 04:36:21.368697 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 04:36:21.368965 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Mon May 9 04:36:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 04:36:21.765919 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d503ce07-8830-4b69-9988-3a69a2265a29 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:36:21.766612 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-d503ce07-8830-4b69-9988-3a69a2265a29 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: 0064c5db-f056-49f6-a8ba-54c3f60c41ec] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:36:21.772974 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d503ce07-8830-4b69-9988-3a69a2265a29 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:21.773439 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d503ce07-8830-4b69-9988-3a69a2265a29 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:21.774195 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d503ce07-8830-4b69-9988-3a69a2265a29 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:21.774635 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-d503ce07-8830-4b69-9988-3a69a2265a29 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:21.788163 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-d503ce07-8830-4b69-9988-3a69a2265a29 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] HTTP exception thrown: Instance 0064c5db-f056-49f6-a8ba-54c3f60c41ec could not be found. May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d503ce07-8830-4b69-9988-3a69a2265a29 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Request method failure captured: May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec HTTP/1.1 May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJhI51Wg1Mh0rXGOkYOhY83gb_85EjAt1dEmV1kwE0E_o-LiDKJllKOYr3RwG8f3fHxZOUeUK-csXwRQGpzve9cTiuCA61_bQOHZ34MipY7rEN8cB_wKoIShklm1dipRQISHpvPSUx9JtSjPLpJy7unxRoJ2iMKpKc2lIb5aD3hB-Co May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: b6223852af9c4361b99a24e7a49a7734 May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-TestVolumeBootPattern-1800052824 May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:36:21.790058 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:36:21.791580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:36:21.791580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-TestVolumeBootPattern-1800052824 May 09 04:36:21.791580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: b6223852af9c4361b99a24e7a49a7734 May 09 04:36:21.791580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800052824 May 09 04:36:21.791580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-TestVolumeBootPattern-1800052824-project May 09 04:36:21.791580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:36:21.791580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:36:21.791580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: cb34feb512764ec5b9ca25c30c3d7159 May 09 04:36:21.791580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-TestVolumeBootPattern-1800052824-project May 09 04:36:21.791580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:36:21.791580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance 0064c5db-f056-49f6-a8ba-54c3f60c41ec could not be found. May 09 04:36:21.791580 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': '0064c5db-f056-49f6-a8ba-54c3f60c41ec'} May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0064c5db-f056-49f6-a8ba-54c3f60c41ec could not be found. May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:36:21.795607 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0064c5db-f056-49f6-a8ba-54c3f60c41ec could not be found. May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0064c5db-f056-49f6-a8ba-54c3f60c41ec could not be found. May 09 04:36:21.797666 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:36:21.798983 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-d503ce07-8830-4b69-9988-3a69a2265a29 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Returning 404 to user: Instance 0064c5db-f056-49f6-a8ba-54c3f60c41ec could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:36:21.798983 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-d503ce07-8830-4b69-9988-3a69a2265a29 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec" status: 404 len: 111 microversion: 2.1 time: 0.029411 May 09 04:36:21.798983 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 592/1178] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:36:21 2022] GET /compute/v2.1/servers/0064c5db-f056-49f6-a8ba-54c3f60c41ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:36:22.231915 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-38e181d8-c47b-435c-809d-8844d3d973ea tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:36:22.232500 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-38e181d8-c47b-435c-809d-8844d3d973ea tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:36:22.238857 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38e181d8-c47b-435c-809d-8844d3d973ea tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:22.239301 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38e181d8-c47b-435c-809d-8844d3d973ea tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:22.240099 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38e181d8-c47b-435c-809d-8844d3d973ea tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:22.240532 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38e181d8-c47b-435c-809d-8844d3d973ea tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:22.253532 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-38e181d8-c47b-435c-809d-8844d3d973ea tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] HTTP exception thrown: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-38e181d8-c47b-435c-809d-8844d3d973ea tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Request method failure captured: May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: request: DELETE /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 HTTP/1.1 May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept: application/json May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Accept-Encoding: identity May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Connection: close May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Length: 0 May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Content-Type: application/json May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Host: 10.222.0.44 May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Openstack-System-Scope: None May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: User-Agent: python-urllib3/1.26.9 May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Auth-Token: gAAAAABieJhI51Wg1Mh0rXGOkYOhY83gb_85EjAt1dEmV1kwE0E_o-LiDKJllKOYr3RwG8f3fHxZOUeUK-csXwRQGpzve9cTiuCA61_bQOHZ34MipY7rEN8cB_wKoIShklm1dipRQISHpvPSUx9JtSjPLpJy7unxRoJ2iMKpKc2lIb5aD3hB-Co May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Id: None May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Domain-Name: None May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Identity-Status: Confirmed May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Is-Admin-Project: True May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Id: default May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Domain-Name: Default May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Id: b6223852af9c4361b99a24e7a49a7734 May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Project-Name: tempest-TestVolumeBootPattern-1800052824 May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Role: reader,member May 09 04:36:22.255136 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Roles: reader,member May 09 04:36:22.256741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:36:22.256741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant: tempest-TestVolumeBootPattern-1800052824 May 09 04:36:22.256741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Id: b6223852af9c4361b99a24e7a49a7734 May 09 04:36:22.256741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800052824 May 09 04:36:22.256741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User: tempest-TestVolumeBootPattern-1800052824-project May 09 04:36:22.256741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Id: default May 09 04:36:22.256741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Domain-Name: Default May 09 04:36:22.256741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Id: cb34feb512764ec5b9ca25c30c3d7159 May 09 04:36:22.256741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: X-User-Name: tempest-TestVolumeBootPattern-1800052824-project May 09 04:36:22.256741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: method: > May 09 04:36:22.256741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: exception: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:36:22.256741 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: action_args: {'id': 'd25d4ade-5644-40c6-81ca-73ccc85df6e1'} May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:36:22.257820 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:36:22.259341 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: ERROR nova.api.openstack.wsgi May 09 04:36:22.260988 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-38e181d8-c47b-435c-809d-8844d3d973ea tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Returning 404 to user: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:36:22.260988 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-38e181d8-c47b-435c-809d-8844d3d973ea tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 404 len: 111 microversion: 2.1 time: 0.029350 May 09 04:36:22.260988 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 587/1179] 10.222.0.44 () {58 vars in 1238 bytes} [Mon May 9 04:36:22 2022] DELETE /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:36:22.266232 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1a606193-30e9-4418-8a55-97f172d0486c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '>' {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:36:22.266846 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.compute.api [None req-1a606193-30e9-4418-8a55-97f172d0486c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] [instance: d25d4ade-5644-40c6-81ca-73ccc85df6e1] Fetching instance by UUID {{(pid=117033) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 04:36:22.273212 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a606193-30e9-4418-8a55-97f172d0486c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:22.273655 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a606193-30e9-4418-8a55-97f172d0486c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:22.274408 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a606193-30e9-4418-8a55-97f172d0486c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 04:36:22.274839 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG oslo_concurrency.lockutils [None req-1a606193-30e9-4418-8a55-97f172d0486c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Lock "d1633d3c-e28c-4cff-8311-7e3f4477d0ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 04:36:22.288868 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.wsgi [None req-1a606193-30e9-4418-8a55-97f172d0486c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] HTTP exception thrown: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1a606193-30e9-4418-8a55-97f172d0486c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Request method failure captured: May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: request: GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 HTTP/1.1 May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept: application/json May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Accept-Encoding: identity May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Connection: close May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Length: 0 May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Content-Type: application/json May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Host: 10.222.0.44 May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Openstack-System-Scope: None May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: User-Agent: python-urllib3/1.26.9 May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Auth-Token: gAAAAABieJhI51Wg1Mh0rXGOkYOhY83gb_85EjAt1dEmV1kwE0E_o-LiDKJllKOYr3RwG8f3fHxZOUeUK-csXwRQGpzve9cTiuCA61_bQOHZ34MipY7rEN8cB_wKoIShklm1dipRQISHpvPSUx9JtSjPLpJy7unxRoJ2iMKpKc2lIb5aD3hB-Co May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Id: None May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Domain-Name: None May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Identity-Status: Confirmed May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Is-Admin-Project: True May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Id: default May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Domain-Name: Default May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Id: b6223852af9c4361b99a24e7a49a7734 May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Project-Name: tempest-TestVolumeBootPattern-1800052824 May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Role: reader,member May 09 04:36:22.290450 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Roles: reader,member May 09 04:36:22.292110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b6223852af9c4361b99a24e7a49a7734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 09 04:36:22.292110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant: tempest-TestVolumeBootPattern-1800052824 May 09 04:36:22.292110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Id: b6223852af9c4361b99a24e7a49a7734 May 09 04:36:22.292110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-Tenant-Name: tempest-TestVolumeBootPattern-1800052824 May 09 04:36:22.292110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User: tempest-TestVolumeBootPattern-1800052824-project May 09 04:36:22.292110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Id: default May 09 04:36:22.292110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Domain-Name: Default May 09 04:36:22.292110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Id: cb34feb512764ec5b9ca25c30c3d7159 May 09 04:36:22.292110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: X-User-Name: tempest-TestVolumeBootPattern-1800052824-project May 09 04:36:22.292110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: method: > May 09 04:36:22.292110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: exception: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:36:22.292110 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: action_args: {'id': 'd25d4ade-5644-40c6-81ca-73ccc85df6e1'} May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: {{(pid=117033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 04:36:22.293004 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. May 09 04:36:22.294193 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: ERROR nova.api.openstack.wsgi May 09 04:36:22.295341 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: DEBUG nova.api.openstack.wsgi [None req-1a606193-30e9-4418-8a55-97f172d0486c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Returning 404 to user: Instance d25d4ade-5644-40c6-81ca-73ccc85df6e1 could not be found. {{(pid=117033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 04:36:22.295341 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO nova.api.openstack.requestlog [None req-1a606193-30e9-4418-8a55-97f172d0486c tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1" status: 404 len: 111 microversion: 2.1 time: 0.029387 May 09 04:36:22.295341 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: [pid: 117033|app: 0|req: 593/1180] 10.222.0.44 () {58 vars in 1235 bytes} [Mon May 9 04:36:22 2022] GET /compute/v2.1/servers/d25d4ade-5644-40c6-81ca-73ccc85df6e1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 04:36:23.570792 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-62bba4bf-5be2-47a3-b3d0-4b4db844adb3 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] Calling method '.version_select at 0x7fbfd46ff4c0>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 04:36:23.596443 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-62bba4bf-5be2-47a3-b3d0-4b4db844adb3 tempest-TestVolumeBootPattern-1800052824 tempest-TestVolumeBootPattern-1800052824-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-901938689" status: 202 len: 0 microversion: 2.1 time: 0.029329 May 09 04:36:23.597593 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 588/1181] 10.222.0.44 () {58 vars in 1259 bytes} [Mon May 9 04:36:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-901938689 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 04:36:24.896835 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 04:36:24.897391 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Mon May 9 04:36:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 04:38:00.190148 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 04:38:00.190826 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Mon May 9 04:38:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 04:38:12.951682 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 04:38:12.952466 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Mon May 9 04:38:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 04:39:41.377152 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 04:39:41.377761 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Mon May 9 04:39:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 04:39:44.905153 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 04:39:44.905635 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Mon May 9 04:39:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 04:41:20.198840 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 04:41:20.199472 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Mon May 9 04:41:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 04:41:32.961263 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 04:41:32.961782 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Mon May 9 04:41:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 04:41:40.544338 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 04:41:40.545081 dv-cinder-838009-3-iscsi devstack@n-api.service[117033]: Mon May 9 04:41:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 04:41:46.212884 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 04:41:46.213435 dv-cinder-838009-3-iscsi devstack@n-api.service[117032]: Mon May 9 04:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!